camera.ui Node SDK

Appearance

@camera.ui/sdk / sensor / ObjectDetectorSensor

Abstract Class: ObjectDetectorSensor<TStorage> ​

Defined in: sensor/object.ts:171

Object detector that receives video frames from the backend pipeline. Extend this class and implement detectObjects and modelSpec. The backend scales frames to match modelSpec.input dimensions before each call.

Extends ​

Type Parameters ​

TStorage ​

TStorage extends object = Record<string, any>

Constructors ​

Constructor ​

new ObjectDetectorSensor<TStorage>(name?, options?): ObjectDetectorSensor<TStorage>

Defined in: sensor/object.ts:80

Parameters ​

name? ​

string = 'Object Sensor'

options? ​

SensorOptions

Returns ​

ObjectDetectorSensor<TStorage>

Inherited from ​

ObjectSensor.constructor

Properties ​

_requiresFrames ​

_requiresFrames: boolean = true

Defined in: sensor/object.ts:172

Overrides ​

ObjectSensor._requiresFrames

category ​

readonly category: Sensor = SensorCategory.Sensor

Defined in: sensor/object.ts:76

Inherited from ​

ObjectSensor.category

name ​

readonly name: string

Defined in: sensor/base.ts:223

Inherited from ​

Sensor.name

onAssignmentChanged ​

readonly onAssignmentChanged: Observable<readonly string[]>

Defined in: sensor/base.ts:250

Inherited from ​

Sensor.onAssignmentChanged

onCapabilitiesChanged ​

readonly onCapabilitiesChanged: Observable<string[]>

Defined in: sensor/base.ts:242

Inherited from ​

ObjectSensor.onCapabilitiesChanged

onConnectedChanged ​

readonly onConnectedChanged: Observable<boolean>

Defined in: sensor/base.ts:252

Inherited from ​

Sensor.onConnectedChanged

onPropertyChanged ​

readonly onPropertyChanged: Observable<PropertyChangeOf<ObjectSensorProperties>>

Defined in: sensor/base.ts:240

Inherited from ​

ObjectSensor.onPropertyChanged

type ​

readonly type: Object = SensorType.Object

Defined in: sensor/object.ts:75

Inherited from ​

ObjectSensor.type

Accessors ​

assignedCameraIds ​

Get Signature ​

get assignedCameraIds(): readonly string[]

Defined in: sensor/base.ts:293

Returns ​

readonly string[]

Inherited from ​

Sensor.assignedCameraIds

assignmentLocked ​

Get Signature ​

get assignmentLocked(): boolean

Defined in: sensor/base.ts:297

Returns ​

boolean

Inherited from ​

Sensor.assignmentLocked

capabilities ​

Get Signature ​

get capabilities(): TCapability[]

Defined in: sensor/base.ts:316

Returns ​

TCapability[]

Set Signature ​

set capabilities(value): void

Defined in: sensor/base.ts:321

Set capabilities, deduplicated, and notify backend plus local listeners.

Parameters ​
value ​

TCapability[]

Returns ​

void

Inherited from ​

ObjectSensor.capabilities

connected ​

Get Signature ​

get connected(): boolean

Defined in: sensor/base.ts:289

Returns ​

boolean

Inherited from ​

Sensor.connected

detected ​

Get Signature ​

get detected(): boolean

Defined in: sensor/object.ts:90

Returns ​

boolean

Inherited from ​

ObjectSensor.detected

detections ​

Get Signature ​

get detections(): TrackedDetection[]

Defined in: sensor/object.ts:94

Returns ​

TrackedDetection[]

Inherited from ​

ObjectSensor.detections

displayName ​

Get Signature ​

get displayName(): string

Defined in: sensor/base.ts:281

Returns ​

string

Inherited from ​

Sensor.displayName

id ​

Get Signature ​

get id(): string

Defined in: sensor/base.ts:269

Returns ​

string

Inherited from ​

Sensor.id

isAssigned ​

Get Signature ​

get isAssigned(): boolean

Defined in: sensor/base.ts:285

Returns ​

boolean

Inherited from ​

VibrationSensor.isAssigned

labels ​

Get Signature ​

get labels(): ("motion" | "audio" | "person" | "vehicle" | "animal")[]

Defined in: sensor/object.ts:98

Returns ​

("motion" | "audio" | "person" | "vehicle" | "animal")[]

Inherited from ​

ObjectSensor.labels

modelSpec ​

Get Signature ​

get abstract modelSpec(): ObjectModelSpec

Defined in: sensor/object.ts:174

Returns ​

ObjectModelSpec

nativeId ​

Get Signature ​

get nativeId(): string | undefined

Defined in: sensor/base.ts:273

Returns ​

string | undefined

Inherited from ​

Sensor.nativeId

origin ​

Get Signature ​

get origin(): string | undefined

Defined in: sensor/base.ts:277

Returns ​

string | undefined

Inherited from ​

VibrationSensor.origin

pluginId ​

Get Signature ​

get pluginId(): string | undefined

Defined in: sensor/base.ts:301

Returns ​

string | undefined

Inherited from ​

Sensor.pluginId

props ​

Get Signature ​

get protected props(): Readonly<TProperties>

Defined in: sensor/base.ts:546

Returns ​

Readonly<TProperties>

Inherited from ​

ObjectSensor.props

storage ​

Get Signature ​

get storage(): DeviceStorage<TStorage>

Defined in: sensor/base.ts:305

Returns ​

DeviceStorage<TStorage>

Inherited from ​

ObjectSensor.storage

storageSchema ​

Get Signature ​

get storageSchema(): JsonSchema[]

Defined in: sensor/base.ts:312

Returns ​

JsonSchema[]

Inherited from ​

VibrationSensor.storageSchema

Methods ​

clearDetections() ​

clearDetections(): void

Defined in: sensor/object.ts:145

Explicitly clear detection state (detected = false, detections = [], labels = []).

Returns ​

void

Example ​

ts
sensor.clearDetections();

Inherited from ​

ObjectSensor.clearDetections

detectObjects() ​

abstract detectObjects(frame): Promise<ObjectResult>

Defined in: sensor/object.ts:177

Analyze a single video frame for objects. Called by the backend at the configured interval.

Parameters ​

frame ​

VideoFrameData

Returns ​

Promise<ObjectResult>

getValue() ​

Call Signature ​

getValue<K>(property): ObjectSensorProperties[K] | undefined

Defined in: sensor/base.ts:345

Get the current value of a sensor property. Calling the generic overload with a property enum value gives a properly typed result.

Type Parameters ​
K ​

K extends keyof ObjectSensorProperties

Parameters ​
property ​

K

Returns ​

ObjectSensorProperties[K] | undefined

Inherited from ​

ObjectSensor.getValue

Call Signature ​

getValue(property): unknown

Defined in: sensor/base.ts:346

Get the current value of a sensor property. Calling the generic overload with a property enum value gives a properly typed result.

Parameters ​
property ​

string

Returns ​

unknown

Inherited from ​

ObjectSensor.getValue

getValues() ​

getValues(): Readonly<TProperties>

Defined in: sensor/base.ts:362

Get a read-only snapshot of all property values.

Returns ​

Readonly<TProperties>

Shallow copy of every property currently held by the sensor.

Example ​

ts
const snapshot = sensor.getValues();
console.log(snapshot);

Inherited from ​

ObjectSensor.getValues

hasCapability() ​

hasCapability(capability): boolean

Defined in: sensor/base.ts:388

Check whether the sensor advertises a capability.

Parameters ​

capability ​

string

Capability flag to look for.

Returns ​

boolean

True if the sensor currently advertises it.

Example ​

ts
const dimmable = sensor.hasCapability('brightness');

Inherited from ​

ObjectSensor.hasCapability

onStart() ​

protected onStart(): void | Promise<void>

Defined in: sensor/base.ts:651

Lifecycle hook, called once the sensor is registered and live (storage and RPC are wired up). Override it to start work whose lifetime matches the sensor's: polling loops, event subscriptions, timers.

Errors thrown here are swallowed, not logged. Handle failures inside the override. Paired 1:1 with onStop, which runs on removal, plugin shutdown or cleanup.

Returns ​

void | Promise<void>

Example ​

ts
protected override onStart(): void {
  this._timer = setInterval(() => this.poll(), 5_000);
}

Inherited from ​

ObjectSensor.onStart

onStop() ​

protected onStop(): void | Promise<void>

Defined in: sensor/base.ts:664

Counterpart of onStart: tear down whatever it started, such as timers, subscriptions and external resources.

Returns ​

void | Promise<void>

Example ​

ts
protected override onStop(): void {
  if (this._timer) clearInterval(this._timer);
}

Inherited from ​

ObjectSensor.onStop

reportDetections() ​

reportDetections(detected, detections?): void

Defined in: sensor/object.ts:127

Report detected objects. Auto-derives detected and labels from the list.

  • reportDetections(true): something detected without specific data. The SDK synthesizes a single full-frame 'motion' detection as a generic fallback.
  • reportDetections(true, [...]): explicit detections (typical case).
  • reportDetections(false): clear.

Parameters ​

detected ​

boolean

Whether any object is currently detected.

detections? ​

TrackedDetection[]

Optional explicit object detections (with optional tracking metadata).

Returns ​

void

Example ​

ts
import type { TrackedDetection } from '@camera.ui/sdk';
sensor.reportDetections(true, [
  {
    label: 'person',
    confidence: 0.92,
    box: { x: 0.1, y: 0.2, width: 0.3, height: 0.4 },
  } satisfies TrackedDetection,
]);
sensor.reportDetections(false);

Inherited from ​

ObjectSensor.reportDetections

setDisplayName() ​

setDisplayName(value): void

Defined in: sensor/base.ts:337

Set the display name (the only mutable identifier on a sensor).

Parameters ​

value ​

string

Human-readable label shown in the UI.

Returns ​

void

Example ​

ts
sensor.setDisplayName('Front Door Motion');

Inherited from ​

ObjectSensor.setDisplayName

updateModelSpec() ​

updateModelSpec(): void

Defined in: sensor/base.ts:565

Re-announces the model spec, e.g. once the models finished loading.

The spec a detector reports at registration is what it knows at that moment: models that load in the background are missing from it. Call this after loading, the server replaces its copy.

Returns ​

void

Example ​

typescript
async onStart(): Promise<void> {
  await this.loadModel();
  this.updateModelSpec();
}

Inherited from ​

ObjectSensor.updateModelSpec