camera.ui Node SDK

Appearance

@camera.ui/sdk / sensor / ObjectDetectorSensor

Abstract Class: ObjectDetectorSensor<TStorage> ​

Defined in: sensor/object.ts:181

Object detector that receives video frames from the backend pipeline. Extend this class and implement detectObjects and modelSpec. The backend scales frames to match modelSpec.input dimensions before each call.

Extends ​

Type Parameters ​

TStorage ​

TStorage extends object = Record<string, any>

Constructors ​

Constructor ​

new ObjectDetectorSensor<TStorage>(name?): ObjectDetectorSensor<TStorage>

Defined in: sensor/object.ts:77

Parameters ​

name? ​

string = 'Object Sensor'

Returns ​

ObjectDetectorSensor<TStorage>

Inherited from ​

ObjectSensor.constructor

Properties ​

_requiresFrames ​

_requiresFrames: boolean = true

Defined in: sensor/object.ts:182

Overrides ​

ObjectSensor._requiresFrames

category ​

readonly category: Sensor = SensorCategory.Sensor

Defined in: sensor/object.ts:73

Inherited from ​

ObjectSensor.category

id ​

readonly id: string

Defined in: sensor/base.ts:190

Inherited from ​

Sensor.id

name ​

readonly name: string

Defined in: sensor/base.ts:189

Inherited from ​

Sensor.name

onAssignmentChanged ​

readonly onAssignmentChanged: Observable<boolean>

Defined in: sensor/base.ts:209

Inherited from ​

ClipDetectorSensor.onAssignmentChanged

onCapabilitiesChanged ​

readonly onCapabilitiesChanged: Observable<string[]>

Defined in: sensor/base.ts:200

Observable for capability changes. Emits the full capabilities array when capabilities change.

Inherited from ​

ObjectSensor.onCapabilitiesChanged

onPropertyChanged ​

readonly onPropertyChanged: Observable<PropertyChangeOf<ObjectSensorProperties>>

Defined in: sensor/base.ts:198

Observable for property changes. Emits { property, value, timestamp } when any property changes.

Inherited from ​

ObjectSensor.onPropertyChanged

type ​

readonly type: Object = SensorType.Object

Defined in: sensor/object.ts:72

Inherited from ​

ObjectSensor.type

Accessors ​

cameraId ​

Get Signature ​

get cameraId(): string

Defined in: sensor/base.ts:257

Camera ID this sensor belongs to. Throws if sensor not yet added to a camera.

Returns ​

string

Inherited from ​

ClipDetectorSensor.cameraId

capabilities ​

Get Signature ​

get capabilities(): TCapability[]

Defined in: sensor/base.ts:277

Optional feature flags advertised by this sensor (e.g., PTZ pan/tilt/zoom)

Returns ​

TCapability[]

Set Signature ​

set capabilities(value): void

Defined in: sensor/base.ts:282

Set capabilities and notify the backend. Automatically deduplicates.

Parameters ​
value ​

TCapability[]

Returns ​

void

Inherited from ​

ObjectSensor.capabilities

detected ​

Get Signature ​

get detected(): boolean

Defined in: sensor/object.ts:88

Whether any object is currently detected.

Returns ​

boolean

Inherited from ​

ObjectSensor.detected

detections ​

Get Signature ​

get detections(): TrackedDetection[]

Defined in: sensor/object.ts:93

Current detection list.

Returns ​

TrackedDetection[]

Inherited from ​

ObjectSensor.detections

displayName ​

Get Signature ​

get displayName(): string

Defined in: sensor/base.ts:233

Returns ​

string

Inherited from ​

Sensor.displayName

isAssigned ​

Get Signature ​

get isAssigned(): boolean

Defined in: sensor/base.ts:252

Whether this sensor has been assigned to a camera in the backend

Returns ​

boolean

Inherited from ​

ClipDetectorSensor.isAssigned

labels ​

Get Signature ​

get labels(): ("motion" | "audio" | "person" | "vehicle" | "animal" | "package")[]

Defined in: sensor/object.ts:98

Unique labels of the current detections.

Returns ​

("motion" | "audio" | "person" | "vehicle" | "animal" | "package")[]

Inherited from ​

ObjectSensor.labels

modelSpec ​

Get Signature ​

get abstract modelSpec(): ObjectModelSpec

Defined in: sensor/object.ts:185

Declares the expected input dimensions. The backend scales frames to match.

Returns ​

ObjectModelSpec

pluginId ​

Get Signature ​

get pluginId(): string | undefined

Defined in: sensor/base.ts:264

Returns ​

string | undefined

Inherited from ​

Sensor.pluginId

props ​

Get Signature ​

get protected props(): Readonly<TProperties>

Defined in: sensor/base.ts:295

Read-only access to the internal property store. Subclasses use this to read current state when implementing semantic methods (e.g., if (this.blocked) return).

Returns ​

Readonly<TProperties>

Inherited from ​

ObjectSensor.props

storage ​

Get Signature ​

get storage(): DeviceStorage<TStorage>

Defined in: sensor/base.ts:269

Per-sensor persistent storage. Throws if sensor not yet added to a camera.

Returns ​

DeviceStorage<TStorage>

Inherited from ​

ObjectSensor.storage

storageSchema ​

Get Signature ​

get storageSchema(): JsonSchema[]

Defined in: sensor/base.ts:216

Override to provide a JSON schema for per-sensor storage settings UI

Returns ​

JsonSchema[]

Inherited from ​

ClipDetectorSensor.storageSchema

Methods ​

clearDetections() ​

clearDetections(): void

Defined in: sensor/object.ts:145

Explicitly clear detection state (detected = false, detections = [], labels = []).

Returns ​

void

Example ​

ts
sensor.clearDetections();

Inherited from ​

ObjectSensor.clearDetections

detectObjects() ​

abstract detectObjects(frame): Promise<ObjectResult>

Defined in: sensor/object.ts:188

Analyze a single video frame for objects. Called by the backend at the configured interval.

Parameters ​

frame ​

VideoFrameData

Returns ​

Promise<ObjectResult>

getValue() ​

Call Signature ​

getValue<K>(property): ObjectSensorProperties[K] | undefined

Defined in: sensor/base.ts:303

Get the current value of a sensor property. Type-safe via the generic overload — call with a property enum value to get a properly typed result.

Type Parameters ​
K ​

K extends keyof ObjectSensorProperties

Parameters ​
property ​

K

Returns ​

ObjectSensorProperties[K] | undefined

Inherited from ​

ObjectSensor.getValue

Call Signature ​

getValue(property): unknown

Defined in: sensor/base.ts:304

Get the current value of a sensor property. Type-safe via the generic overload — call with a property enum value to get a properly typed result.

Parameters ​
property ​

string

Returns ​

unknown

Inherited from ​

ObjectSensor.getValue

getValues() ​

getValues(): Readonly<TProperties>

Defined in: sensor/base.ts:320

Get a read-only snapshot of all property values.

Returns ​

Readonly<TProperties>

Frozen view of every property currently held by the sensor.

Example ​

ts
const snapshot = sensor.getValues();
console.log(snapshot);

Inherited from ​

ObjectSensor.getValues

hasCapability() ​

hasCapability(capability): boolean

Defined in: sensor/base.ts:423

Parameters ​

capability ​

string

Returns ​

boolean

Inherited from ​

ObjectSensor.hasCapability

onAssigned() ​

protected onAssigned(): void | Promise<void>

Defined in: sensor/base.ts:473

Lifecycle hook: the sensor just became assigned to a camera. Override to start background work that should only run while this sensor is live — polling loops, event subscriptions, timers, external connections.

Called AFTER cameraId, storage, and RPC channels are wired up, so the override can safely access this.cameraId, this.storage, and publish properties via the semantic helper methods.

Errors thrown here are caught and logged — they will NOT break assignment bookkeeping. If your work can fail, handle it inside the override.

Paired 1:1 with onDeassigned — for every onAssigned call there is exactly one matching onDeassigned later (on deassignment or cleanup).

Default: no-op. Most sensors don't need lifecycle hooks.

Returns ​

void | Promise<void>

Example ​

ts
protected override async onAssigned(): Promise<void> {
  this._timer = setInterval(() => this.poll(), 5_000);
}

Inherited from ​

ObjectSensor.onAssigned

onDeassigned() ​

protected onDeassigned(): void | Promise<void>

Defined in: sensor/base.ts:493

Lifecycle hook: the sensor is being deassigned. Override to tear down whatever was started in onAssigned — clear timers, close subscriptions, release external resources.

Always called exactly once for each prior onAssigned. Also called from _cleanup if the sensor is being removed while still assigned, so you can rely on this as the single teardown point.

Default: no-op.

Returns ​

void | Promise<void>

Example ​

ts
protected override onDeassigned(): void {
  if (this._timer) clearInterval(this._timer);
}

Inherited from ​

ObjectSensor.onDeassigned

reportDetections() ​

reportDetections(detected, detections?): void

Defined in: sensor/object.ts:127

Report detected objects. Auto-derives detected and labels from the list.

  • reportDetections(true) — something detected without specific data. The SDK synthesizes a single full-frame 'motion' detection as a generic fallback.
  • reportDetections(true, [...]) — explicit detections (typical case).
  • reportDetections(false) — clear.

Parameters ​

detected ​

boolean

Whether any object is currently detected.

detections? ​

TrackedDetection[]

Optional explicit object detections (with optional tracking metadata).

Returns ​

void

Example ​

ts
import type { TrackedDetection } from '@camera.ui/sdk';
sensor.reportDetections(true, [
  {
    label: 'person',
    confidence: 0.92,
    box: { x: 0.1, y: 0.2, width: 0.3, height: 0.4 },
  } satisfies TrackedDetection,
]);
sensor.reportDetections(false);

Inherited from ​

ObjectSensor.reportDetections

setDisplayName() ​

setDisplayName(value): void

Defined in: sensor/base.ts:247

Set the display name (the only mutable identifier on a sensor).

Parameters ​

value ​

string

Human-readable label shown in the UI.

Returns ​

void

Example ​

ts
sensor.setDisplayName('Front Door Motion');

Inherited from ​

ObjectSensor.setDisplayName