« Find Xojo Consultants… | Home | MBS Xojo Plugins, ver… »

Vision Framework for Xojo

For the next MBS Xojo Plugins, we worked on including the Vision framework from Apple. Our new vision plugin part (in MacFrameworks) covers the whole framework with all 49 classes and one module for globals. We even include the new features coming with MacOS 10.15 Catalina release. All functions can be used asynchronously with delegates for the callbacks. The plugin makes sure those callbacks execute on main thread to avoid threading issues in Xojo.

The Vision framework performs face and face landmark detection, text detection, barcode recognition, image registration, and general feature tracking. Vision also allows the use of custom Core ML models for tasks like classification or object detection.

With Catalina you also get classification, text recognition, attention and object based saliency, animal and human detection.

You can read Apple's documentation here.

Here our new classes:

• class VNBarcodeObservationMBS
• class VNClassificationObservationMBS
• class VNClassifyImageRequestMBS
• class VNCoreMLFeatureValueObservationMBS
• class VNCoreMLModelMBS
• class VNCoreMLRequestMBS
• class VNDetectBarcodesRequestMBS
• class VNDetectedObjectObservationMBS
• class VNDetectFaceCaptureQualityRequestMBS
• class VNDetectFaceLandmarksRequestMBS
• class VNDetectFaceRectanglesRequestMBS
• class VNDetectHorizonRequestMBS
• class VNDetectHumanRectanglesRequestMBS
• class VNDetectRectanglesRequestMBS
• class VNDetectTextRectanglesRequestMBS
• class VNFaceLandmarkRegion2DMBS
• class VNFaceLandmarkRegionMBS
• class VNFaceLandmarks2DMBS
• class VNFaceLandmarksMBS
• class VNFaceObservationMBS
• class VNFeaturePrintObservationMBS
• class VNGenerateAttentionBasedSaliencyImageRequestMBS
• class VNGenerateImageFeaturePrintRequestMBS
• class VNGenerateObjectnessBasedSaliencyImageRequestMBS
• class VNHomographicImageRegistrationRequestMBS
• class VNHorizonObservationMBS
• class VNImageAlignmentObservationMBS
• class VNImageBasedRequestMBS
• class VNImageHomographicAlignmentObservationMBS
• class VNImageRegistrationRequestMBS
• class VNImageRequestHandlerMBS
• class VNImageTranslationAlignmentObservationMBS
• class VNObservationMBS
• class VNPixelBufferObservationMBS
• class VNRecognizeAnimalsRequestMBS
• class VNRecognizedObjectObservationMBS
• class VNRecognizedTextMBS
• class VNRecognizedTextObservationMBS
• class VNRecognizeTextRequestMBS
• class VNRectangleObservationMBS
• class VNRequestMBS
• class VNSaliencyImageObservationMBS
• class VNSequenceRequestHandlerMBS
• class VNTargetedImageRequestMBS
• class VNTextObservationMBS
• class VNTrackingRequestMBS
• class VNTrackObjectRequestMBS
• class VNTrackRectangleRequestMBS
• class VNTranslationalImageRegistrationRequestMBS
• module VisionModuleMBS

A few examples are in the make, but please let us know what you'd like to see.

17 08 19 - 12:17