Package Jitter

jit.web~

Render a web browser to a GL texture or matrix

Description

Embeds a Chromium (CEF) browser engine for offscreen web rendering. Renders HTML/CSS/JavaScript content including WebGL and WebGPU to a jit.matrix or jit.gl.texture for use in the Jitter GL pipeline. Supports mouse and keyboard interaction, and transparent backgrounds.

Matrix Operator

matrix inputs:0, matrix outputs:1
Name IOProc Planelink Typelink Dimlink Plane Dim Type
out n/a 1 1 1 4 1 char

More about Matrix Operators

The Jitter MOP

Since the matrix is Jitter's focus, it is not surprising that the majority of Jitter objects fall in this category of Matrix Operators. Every Matrix operator has some number of matrix inputs and some number of matrix outputs. Matrix inputs are referred to by the names "in", "in2", "in3", etc., from left to right, and matrix outputs are referred to by the names "out", "out2", "out3", etc., from left to right--i.e. the names are appended by the input/output number except for the first (leftmost) input and first (leftmost) output which are simply named "in" and "out". We will refer to the input or output name names as the "I/O-name".

Matrix inputs and outputs typically each have their own matrices internally where information is kept. This is necessary because Jitter is an asynchronous framework (i.e. all the matrices don't arrive at all inputs at the same time). Various aspects of matrix inputs and outputs can be set using the command [I/O-name] combined with one of the following suffixes: "_dim" which will set the dimensions of the specified I/O matrix, "_type" which will set the type of the specified matrix, "_planecount" which will set the plane of the specified matrix, or "_name" which will set the name of the specified matrix. There is one special case which does not have an internal matrix and this is the first input "in". This is the case since this special input actually triggers the calculation of the matrix operator, so it doesn't need to be cached until a calulation takes place, unlike the other inputs. Therefore there is no mechanism to set the dim, planecount, type, or name of "in".

Matrix operators accept what we'll refer to as "matrix args"--i.e. [planecount (int)] [ type (symbol)] [dim (int list)] . if these arguments are present, the adapt attribute will be turned off, otherwise it will be turned on. If adapt mode is turned on, each time a matrix is received in the first input, there will also be the equivalent of setting the dim , planecount , and type attributes to that of the input matrix. If the other inputs and outputs are linked to these attributes, this will affect their linked attributes as well. See the "MOP" table to determine which inputs and outputs will be linked to which attributes when adapt mode is turned on. For the leftmost input this is not applicable, and hence all columns are labelled "n/a".

The jit.matrix object is a named matrix which may be used to matrix data storage and retrieval, resampling, and matrix type and planecount conversion operations.

MOP Arguments

planecount[int]
optional

Explicitly sets the number of planes for the output and any righthand inputs. If this is absent, the Matrix Operator will typically adapt to the lefthand incoming matrix attributes, except for special case operators.

type[symbol]
optional

Explicitly sets the type of the matrix for the output and any righthand inputs. If this is absent, the Matrix Operator will typically adapt to the lefthand incoming matrix attributes, except for special case operators.

dimensions[list]
optional

Explicitly sets the dimensions of the matrix for the output and any righthand inputs. If this is absent, the Matrix Operator will typically adapt to the lefthand incoming matrix attributes, except for special case operators.

MOP Attributes

adapt[int]

Matrix adaptation flag (default = 0 if matrix arguments are present, otherwise 1) When the flag is set, the jit.matrix object will adapt to the incoming matrix planecount, type, and dimensions.

[in/out]_dim[32 ints]

The matrix data dimensions (default = 1 1)

[in/out]_name[symbol]

The input or output name of the matrix (default = UID)

[in/out]_planecount[int]

The number of planes in matrix input our output data. Except in special cases, this value is equal to the planecount .

[in/out]_type[symbol]

The input or output matrix data type. Except in special cases, this value is equal to type .

outputmode[int]

Output mode (default = 1 (calculate and output matrix))
0 = No output (no calculation)
1 = Calculate and output the matrix
2 = Pass input (no calculation)
3 = Pass output (no calculation)

type[int]

The matrix data type (default = char
Supported data types are char , long , float32 , or float64 .

MOP Messages

bang

Equivalent to the outputmatrix message.

clear

Sets all cell values in a matrix to zero.

exportattrs

Exports an object's current attributes values in XML format. If no filename is specified, a file dialog will open to let you choose a file.

Arguments:
  • filename [symbol]

getattributes

Sends a sequence of lists out the object's right outlet describing the object's attributes, one line per attribute. Each line listing takes the form attribute attribute-name get get-value set foo set-value data-type(s) number-of-values .

getstate

Sends a sequence of lists describing the object's state out the object's right outlet, one line per attribute. Each line listing line takes the form attribute-name attribute-value1 attribute-value2 ... attribute-valueN .

importattrs

Imports attributes specified in XML format to set the object's attributes. If no filename is specified, a file dialog will open to let you choose a file.

Arguments:
  • filename [symbol]

jit_matrix

Handles input for the named matrix. If this messages is received in the left inlet, output is typically triggered. If this message is received in any other inlet, the data is typically cached until the jit_matrix message is received in the left inlet.

Arguments:
  • matrix-name [symbol]

outputmatrix

Sends the matrix out the left outlet.

summary

Sends a sequence of lists describing the object and it attributes and messages out the rightmost outlet of the object. The first output line takes the form summary objectname object-name . The second and third lines describe the number of inlets and outlets for the object in the form summary (matrixinputcount/matrixoutletcount) number-of-(inlets/outlets) . The fourth line describes the matrixoutput in the form summary matrixoutput descriptor planelink planelink-value typelink typelink-value dimlink dimlink-value types data-type(s) . Each attribute for the object is then listed, one attribute per line. Each line listing takes the form summary attribute attribute-name attribute-value1 attribute-value2 ... attribute-valueN .

Attributes

automatic[int]

When enabled, the object is automatically driven by the jit.world render loop via the animator interface (default = 1).

consolelog[int]

Forward Page Console To Max

dim[2 ints]

The pixel dimensions of the browser canvas (width and height) and the output texture or matrix (default = 640 480). Changes take effect immediately, resizing the browser's virtual viewport.

drawto[symbol]

The name of the GL rendering context (e.g. from jit.world) that this object draws to. Automatically detected when placed in a patcher with a jit.world.

fixed_delta[float]
>= 9.0.0

When set to a non-zero value, uses a fixed delta time for animation updates instead of the actual elapsed time.

fps[int]

The target frame rate for CEF's offscreen rendering (default = 60). Range is 1 to 240. Changes take effect immediately on the live browser.

name[symbol]

A unique name for this object instance.

texture_name[symbol]

The name of the output jit.gl.texture (read-only). Only valid when operating in texture output mode.

ui_listen[int]

Sets whether mouse and keyboard events from the attached GL context are forwarded to the hosted page (default = 1). When disabled, the page receives no input from the context, and the mousemove , mousescroll , mousedown , mouseup , mousedrag , keydown and keyup messages become the only way to drive it.

ui_priority[int]

Sets the priority for receiving mouse and keyboard events from the GL context. Higher priority objects receive events first.

url[symbol]

The URL to load in the browser. Supports http:// , https:// , and file:// URLs. Setting this attribute loads the page immediately.

Common Box Attributes

Below is a list of attributes shared by all objects. If you want to change one of these attributes for an object based on the object box, you need to place the word sendbox in front of the attribute name, or use the object's Inspector.

annotation[symbol]

Sets the text that will be displayed in the Clue window when the user moves the mouse over the object.

background[int]: 0

Adds or removes the object from the patcher's background layer. background 1 adds the object to the background layer, background 0 removes it. Objects in the background layer are shown behind all objects in the default foreground layer.

color[4 floats]

Sets the color for the object box outline.

fontface[int]

Sets the type style used by the object. The options are:

plain
bold
italic
bold italic
Possible values:

0 = 'regular'
1 = 'bold'
2 = 'italic'
3 = 'bold italic'

fontname[symbol]

Sets the object's font.

fontsize[float]

Sets the object's font size (in points).
Possible values:

'8'
'9'
'10'
'11'
'12'
'13'
'14'
'16'
'18'
'20'
'24'
'30'
'36'
'48'
'64'
'72'

hidden[int]: 0

Toggles whether an object is hidden when the patcher is locked.

hint[symbol]

Sets the text that will be displayed in as a pop-up hint when the user moves the mouse over the object in a locked patcher.

ignoreclick[int]: 0

Toggles whether an object ignores mouse clicks in a locked patcher.

jspainterfile[symbol]

You can override the default appearance of a user interface object by assigning a JavaScript file with code for painting the object. The file must be in the search path.

patching_rect[4 floats]: 0. 0. 100. 0.

Aliases: patching_position, patching_size

Sets the position and size of the object in the patcher window.

position[2 floats]
write-only

Sets the object's x and y position in both patching and presentation modes (if the object belongs to its patcher's presentation), leaving its size unchanged.

presentation[int]: 0

Sets whether an object belongs to the patcher's presentation.

presentation_rect[4 floats]: 0. 0. 0. 0.

Aliases: presentation_position, presentation_size

Sets the x and y position and width and height of the object in the patcher's presentation, leaving its patching position unchanged.

rect[4 floats]
write-only

Sets the x and y position and width and height of the object in both patching and presentation modes (if the object belongs to its patcher's presentation).

size[2 floats]
write-only

Sets the object's width and height in both patching and presentation modes (if the object belongs to its patcher's presentation), leaving its position unchanged.

textcolor[4 floats]

Sets the color for the object's text in RGBA format.

textjustification[int]

Sets the justification for the object's text.
Possible values:

0 = 'left'
1 = 'center'
2 = 'right'

valuepopup[int]: 0

For objects with single values, enabling valuepopup will display the object's current value in a popup caption when the mouse is over the object or it is being changed with the mouse.

valuepopuplabel[int]: 0

Sets the source of a text label shown in a value popup caption.
Possible values:

0 = 'None'
1 = 'Hint'
2 = 'Scripting Name'
3 = 'Parameter Long Name'
4 = 'Parameter Short Name'

varname[symbol]

Sets the patcher's scripting name, which can be used to address the object by name in pattr, scripting messages to thispatcher, and the js object.

Messages

int

Passed to the browser as a JavaScript message

float

Passed to the browser as a JavaScript message

list

Passed to the browser as a JavaScript message

anything

Any unrecognized message is forwarded to the browser's JavaScript context via the MaxAPI message handler, enabling communication between Max and web page scripts.

back

Navigates the browser to the previous page in its history.

forward

Navigates the browser to the next page in its history.

keydown

Sends a key press to the hosted page. Takes a character (either a single-character symbol or a character code), plus an optional Max modifier bitfield and an optional platform-native key code. Keys that produce no character, such as arrows and function keys, only reach the page if the platform key code is supplied.

Arguments:
  • key code or character [int]
  • platform key code [int]
  • modifiers [int]

keyup

Sends a key release to the hosted page. Arguments match keydown .

Arguments:
  • key code or character [int]
  • platform key code [int]
  • modifiers [int]

(mouse)

Mouse events from the drawing context when ui_listen enabled.

mousemove

Sends a mouse move to the hosted page. Takes an x and a y coordinate in page pixels (i.e. within dim), plus an optional Max modifier bitfield. When the modifiers name no mouse button, the left button is assumed.

Arguments:
  • horizontal position [int]
  • vertical position [int]
  • modifiers [int]

mousescroll

Sends a mouse wheel event to the hosted page, taking an x and a y delta plus an optional Max modifier bitfield. The event is delivered at the last position seen by any mouse message, so send mousemove first to aim it.

Arguments:
  • delta X [int]
  • delta Y [int]
  • modifiers [int]

readfile

Opens a file dialog to select an HTML file for loading. If a symbol argument is provided, loads that file path directly. The file path is converted to a file:// URL.

reload

Reloads the current page. An optional integer argument of 1 forces a reload that ignores the browser cache.

See Also

Name Description
jit.web~ Render a web browser to a GL texture or matrix with audio output
jweb Web browser
jweb~ Web browser with audio output
jit.world The Jitter world context
jit.gl.texture Create OpenGL textures