Filter by region:

Sort by year:

System and method for unsupervised superpixel-driven instance segmentation of remote sensing image

Zhicheng Yang, Hang Zhou, Jui-Hsin Lai, and Mei Han
USPatent: US20230252644A1,  Publication: 2023-08-10

Abstract

A system and method for unsupervised superpixel-driven instance segmentation of a remote sensing image are provided. The remote sensing image is divided into one or more image patches. The one or more image patches are processed to generate one or more superpixel aggregation patches based on a graph-based aggregation model, respectively. The graph-based aggregation model is configured to learn at least one of a spatial affinity or a feature affinity of a plurality of superpixels from each image patch and aggregate the plurality of superpixels based on the at least one of the spatial affinity or the feature affinity of the plurality of superpixels. The one or more superpixel aggregation patches are combined into an instance segmentation image.

System and method for monitoring emission of greenhouse gas

Andy Jiaying Wong, Hang Zhou, Jui-Hsin Lai, and Mei Han
USPatent: US20230168232A1,  Publication: 2023-06-01

Abstract

A system and a method for monitoring emission of a greenhouse gas are disclosed. A plurality of satellite observations associated with the emission of the greenhouse gas in a first region of interest are received from a plurality of satellite data sources, respectively. The plurality of satellite observations are fused to generate a fused input data set. An emission estimation model is used to generate a first emission estimate of the greenhouse gas in the first region of interest based on the fused input data set.

时尚风格推荐系统和方法

Jui-Hsin Lai, Guanghan Ning, Guifang Dong, Jia Lin, Zijing Zou, and Chi Zhang
CNPatent: CN115917573A,  Publication: 2023-04-04

Abstract

一种用于推荐时尚项目集的方法和系统。该方法包括:提供时尚类别、时尚图以及针对每个时尚图的搭配方案,其中每个时尚图对应一个时尚类别;接收具有查询时尚属性的查询时尚项目;选择时尚类别,其中所选时尚类别中的查询时尚属性具有最高数量的时尚项目;在查询时尚项目的图像与搭配方案中的时尚项目的图像之间执行相似度搜索;将搜索到的搭配方案映射到选定的时尚类别的时尚图以获得与搜索到的搭配方案中的时尚项目相匹配的节点;以及推荐分别选自于匹配节点中的时尚项目的时尚项目集。搭配方案是基于来自相应时尚图的任意两个节点的时尚项目的共同出现而生成的。

System and method for removing haze from remote sensing images

Hang Zhou, Jui-Hsin Lai, and Mei Han
USPatent: US20230026811A1,  Publication: 2023-01-26

Abstract

A system and a method for removing haze from remote sensing images are disclosed. One or more hazy input images with at least four spectral channels and one or more target images with the at least four spectral channels are generated. The one or more hazy input images correspond to the one or more target images, respectively. A dehazing deep learning model is trained using the one or more hazy input images and the one or more target images. The dehazing deep learning model is provided for haze removal processing.

System and method for animal detection

Chen Du, Jui-Hsin Lai, and Mei Han
WOPatent: WO2023273587A1,  Publication: 2023-01-05

Abstract

A system (101) and a method for detecting animals in a region of interest, an image (202) that captures a scene in the region of interest is received. The image (202) is fed to an animal detection model (250) to produce a group of probability maps (208) for a group of key points and a group of affinity field maps (206) for a group of key point sets. One or more connection graphs (216) are determined based on the group of probability maps (208) and the group of affinity field maps (206). Each connection graph (216) outlines a presence of an animal in the image (202). One or more animals present in the region of interest are detected based on the one or more connection graphs (216).

System and method for super-resolution image processing in remote sensing

Yuchuan Gou, Jui-Hsin Lai, and Mei Han
WOPatent: WO2022267693A1,  Publication: 2022-12-29

Abstract

A system and a method for super-resolution image processing in remote sensing are disclosed. One or more sets of multi-temporal images with an input resolution and one or more first target images with a first output resolution are generated from one or more data sources. The first output resolution is higher than the input resolution. Each set of multi-temporal images is processed to improve an image match in the corresponding set of multi-temporal images. The one or more sets of multi-temporal images are associated with the one or more first target images to generate a training dataset. A deep learning model is trained using the training dataset. The deep learning model is provided for subsequent super-resolution image processing.

System and method for animal detection

Chen Du, Jui-Hsin Lai, and Mei Han
USPatent: US20220408698A1,  Publication: 2022-12-29

Abstract

A system and a method for detecting animals in a region of interest are disclosed. An image that captures a scene in the region of interest is received. The image is fed to an animal detection model to produce a group of probability maps for a group of key points and a group of affinity field maps for a group of key point sets. One or more connection graphs are determined based on the group of probability maps and the group of affinity field maps. Each connection graph outlines a presence of an animal in the image. One or more animals present in the region of interest are detected based on the one or more connection graphs.

System and method for super-resolution image processing in remote sensing

Yuchuan Gou, Jui-Hsin Lai, and Mei Han
USPatent: US20220405883A1,  Publication: 2022-12-22

Abstract

A system and a method for super-resolution image processing in remote sensing are disclosed. One or more sets of multi-temporal images with an input resolution and one or more first target images with a first output resolution are generated from one or more data sources. The first output resolution is higher than the input resolution. Each set of multi-temporal images is processed to improve an image match in the corresponding set of multi-temporal images. The one or more sets of multi-temporal images are associated with the one or more first target images to generate a training dataset. A deep learning model is trained using the training dataset. The deep learning model is provided for subsequent super-resolution image processing.

System and method for image-based crop identification

Chen Du, Jui-Hsin Lai, and Mei Han
USPatent: US20220391614A1,  Publication: 2022-12-08

Abstract

A system and a method for image-based crop identification are disclosed. The image-based crop identification system includes a database, a communication module and a model library. The database stores sample aerial data and annotated aerial data. The communication module is coupled to the database, and is configured to provide the sample aerial data to a user and receive the annotated aerial data from the user. The model library is coupled to the database, and is configured to obtain the annotated aerial data, train a crop classification model based on the annotated aerial data, and provide the trained crop classification model for subsequent crop identification. The annotated aerial data include determination of the type of the crop appearing in the sample aerial data.

System and method for image-based crop identification

Chen Du, Jui-Hsin Lai, and Mei Han
WOPatent: WO2022252892A1,  Publication: 2022-12-08

Abstract

A system and a method for image-based crop identification are disclosed. The image-based crop identification system includes a database, a communication module and a model library. The database stores sample aerial data and annotated aerial data. The communication module is coupled to the database, and is configured to provide the sample aerial data to a user and receive the annotated aerial data from the user. The model library is coupled to the database, and is configured to obtain the annotated aerial data, train a crop classification model based on the annotated aerial data, and provide the trained crop classification model for subsequent crop identification. The annotated aerial data include determination of the type of the crop appearing in the sample aerial data.

System and method for fashion style recommendation

Jui-Hsin Lai, Guanghan Ning, Guifang Dong, Jia Lin, Zijing Zou, and Chi Zhang
WOPatent: WO2021218973A1,  Publication: 2021-11-04

Abstract

A system and a method for recommending a set of fashion items. The method includes: providing fashion categories, fashion graphs each corresponding to one fashion category, and fitting formulas for each fashion graph; receiving a query fashion item having a query fashion attribute; selecting a fashion category, where the query fashion attribute in the selected fashion category has a highest number of fashion items; performing a similarity search between image of the query fashion item and images of fashion items in the fitting formulas; mapping the searched fitting formula to the fashion graph of the selected fashion category to obtain nodes matching the fashion items in the searched fitting formula; and recommending the set of fashion items respectively selected from fashion items in the matched nodes. The fitting formulas are generated based on co-appearance of fashion items from any two nodes of the corresponding fashion graph.

System and method for fashion style recommendation

Jui-Hsin Lai, Guanghan Ning, Guifang Dong, Jia Lin, Zijing Zou, and Chi Zhang
USPatent: US20210334877A1,  Publication: 2021-10-28

Abstract

A system and a method for recommending a set of fashion items. The method includes: providing fashion categories, fashion graphs each corresponding to one fashion category, and fitting formulas for each fashion graph; receiving a query fashion item having a query fashion attribute; selecting a fashion category, where the query fashion attribute in the selected fashion category has a highest number of fashion items; performing a similarity search between image of the query fashion item and images of fashion items in the fitting formulas; mapping the searched fitting formula to the fashion graph of the selected fashion category to obtain nodes matching the fashion items in the searched fitting formula; and recommending the set of fashion items respectively selected from fashion items in the matched nodes. The fitting formulas are generated based on co-appearance of fashion items from any two nodes of the corresponding fashion graph.

Face swap method and computing device

Jinghong Miao, Yuchuan Gou, Minghao LI, Jui-Hsin Lai, Bo Gong, and Mei Han
USPatent: US11120595B2,  Publication: 2021-07-01,  Grant: 2021-09-14

Abstract

In a face swap method carried out by an electronic device, a first head image is segmented from a destination image. First facial landmarks and a first hair mask are obtained according to the first head image. A second head image is segmented from a source image. Second facial landmarks and a second hair mask are obtained according to the second head image. If at least one eye landmark in the second facial landmarks is covered by hair, the second head image and the second hair mask are processed and repaired so as to obtain a swapped-face image with eyes not covered by hair.

用于基于可视元素的物品推荐的设备及方法

Guanghan Ning, Xiaofan Zhang, Jui-Hsin Lai, and Chi Zhang
CNPatent: CN112330383A,  Publication: 2021-02-05

Abstract

一种用于基于可视元素的物品推荐的方法、设备和非暂时性计算机可读介质。所述方法包括:通过一个或多个处理器根据物品的物品图像确定可视元素;通过一个或多个处理器至少基于可视元素的一部分生成物品的元素描述符;以及通过一个或多个处理器计算元素描述符与一个或多个其他物品的一个或多个其他元素描述符之间的相容性值。

Device and method for item recommendation based on visual elements

Guanghan Ning, Xiaofan Zhang, Jui-Hsin Lai, and Chi Zhang
USPatent: US11475500B2,  Publication: 2021-02-04,  Grant: 2022-10-18

Abstract

A method, a device, and a non-transitory computer readable medium for item recommendation based on visual elements. The method includes: determining, by one or more processors, visual elements from an item image of an item; generating, by the one or more processors, an element descriptor for the item based on at least a part of the visual elements; and calculating, by the one or more processors, a compatibility value between the element descriptor and one or more other element descriptors for one or more other items.

搭配场景识别方法和装置

Jui-Hsin Lai, Jingen Liu, and Tao Mei
CNPatent: CN111797663A,  Publication: 2020-10-20

Abstract

本公开提供一种搭配场景识别方法和装置。搭配场景识别装置在物品集合中,计算物品u与物品v的搭配值d(u,v),在与每个主题场景p相对应的图Gp中,将搭配值d(u,v)作为节点U和节点V之间的边的值,在图Gp中,对各边的值进行加权处理,以得到相应的主题场景值,将具有超过预设门限的主题场景值的图所对应的主题场景作为物品集合对应的搭配场景。本公开能够为不同类型的服饰搭配确定相应的搭配场景。

Planar fabrication of micro-needles

Li-Wen Hung, Jui-Hsin Lai, Chia-Yu Chen, and Ko-Tao Lee
USPatent: US10940554B2,  Publication: 2020-06-04,  Grant: 2021-03-09

Abstract

Methods of fabricating a probe are described. In an example, a structure may be formed on a surface of a substrate. The structure may include the probe, a hinge, and an anchor arranged linearly, where an angle is formed between the probe and the hinge. The hinge may be positioned between the probe and the anchor, and the structure may be parallel to the substrate. An amount of solder may be deposited on an area of the structure that spans from a portion of the probe to a portion of the anchor, and across the hinge. The deposited solder may be reshaped by an execution of a solder reflow process. The reshape of the deposited solder may cause the probe to rotate about the hinge in order to reduce the angle between the probe and the hinge.

Inference focus for offline training of sram inference engine in binary neural network

Chia-Yu Chen, Jui-Hsin Lai, Ko-Tao Lee, and Li-Wen Hung
USPatent: US11599785B2,  Publication: 2020-05-14,  Grant: 2023-03-07

Abstract

A Static Random Access Memory (SRAM) device in a binary neural network is provided. The SRAM device includes an SRAM inference engine having an SRAM computation architecture with a forward path that include multiple SRAM cells forming a chain of SRAM cells such that an output of a given one of the multiple SRAM cells is an input to a following one of the multiple SRAM cells. The SRAM computation architecture is configured to compute a prediction from an input. The SRAM computation architecture is configured to store ternary data and perform local computations on the ternary data.

Inference focus for offline training of sram inference engine in binary neural network

Chia-Yu Chen, Jui-Hsin Lai, Ko-Tao Lee, and Li-Wen Hung
USPatent: US11599785B2,  Publication: 2020-05-14,  Grant: 2023-03-07

Abstract

A Static Random Access Memory (SRAM) device in a binary neural network is provided. The SRAM device includes an SRAM inference engine having an SRAM computation architecture with a forward path that include multiple SRAM cells. The multiple SRAM cells are configured to form a chain of SRAM cells such that an output of a given one of the multiple SRAM cells is an input to a following one of the multiple SRAM cells. The SRAM computation architecture is configured to compute a prediction from an input.

Infrared detectors and thermal tags for real-time activity monitoring

Li-Wen Hung, and Jui-Hsin Lai
USPatent: US20200058394A1,  Publication: 2020-02-20,  Grant: 2020-02-20

Abstract

Methods and systems for activity monitoring include capturing an infrared image of an environment that comprises at least one patient being monitored and at least one infrared-emitting tag. A relationship between the patient being monitored and the at least one infrared-emitting tag is determined. An activity conducted by the patient being monitored is determined based on the relationship between the patient being monitored and the at least one infrared-emitting tag. A course of treatment for the patient being monitored is adjusted based on the determined activity.

Thermal tags for real-time activity monitoring and methods for fabricating the same

Li-Wen Hung and Jui-Hsin Lai
USPatent: US10835156B2,  Publication: 2019-09-12,  Grant: 2020-11-17

Abstract

A thermal tag for activity monitoring. The thermal tag includes a base layer having a plurality of metal lines to provide a conductive path, and a pattern layer having one or more infrared emitting features positioned over portions of the conductive path, wherein at least one infrared emitting feature couples to the conductive path to emit a predetermined infrared pattern in accordance with nearby activity.

Echtzeit-aktivitätsüberwachung unter verwendung von thermo-tags

Li-Wen Hung and Jui-Hsin Lai
DEPatent: DE112017005263T5,  Publication: 2019-08-22

Abstract

Ein Thermo-Tag enthält eine Stromquelle zum Erzeugen von Strom entlang eines Widerstandswegs und eine Mehrzahl von infrarotemittierenden Elementen, die entlang des Widerstandswegs positioniert sind, um infrarotes Licht entlang eines infrarotemittierenden Musters auszustrahlen, wobei die Mehrzahl von infrarotemittierenden Elementen einen oder mehrere infrarotemittierende Streifen auf einer ersten Oberfläche des Thermo-Tags enthält, die einen Musterbereich definieren, und eine Mehrzahl von infrarotemittierenden Punkten in einem Abschnitt des Musterbereichs, um ein thermodiffusionsbeständiges Muster zur Aktivitätsüberwachung bereitzustellen.

Thermo-Tags für die Echtzeit-Aktivitätsüberwachung und Verfahren zu ihrer Herstellung

Li-Wen Hung and Jui-Hsin Lai
DEPatent: DE112017005266T5,  Publication: 2019-08-14

Abstract

Ein Thermo-Tag für die Aktivitätsüberwachung. Das Thermo-Tag beinhaltet eine Basisschicht mit einer Mehrzahl von Metallleitungen, um eine Leiterbahn bereitzustellen, und eine Musterschicht mit einem oder mehreren infrarotemittierenden Merkmalen, die über Teilen der Leiterbahn angeordnet sind, wobei mindestens ein infrarotemittierendes Merkmal mit der Leiterbahn gekoppelt ist, um gemäß einer in der Nähe stattfindenden Aktivität ein vorbestimmtes Infrarotmuster zu emittieren. 

Thermal face image use for health estimation

Jui-Hsin Lai, Yinglong Xia, Jen-Hao Hsiao, and Yu Zhang
USPatent: US20190216333A1,  Publication: 2019-07-18

Abstract

A computer implemented method includes capturing, via a camera, one or more digital images of a face of a person representative of blood circulation of the person, collecting context information via one or more processors corresponding to the person contemporaneously with the capturing of the one or more digital images, labeling, via a trained individual health model executing on the one or more processors, the one or more digital images based on the blood circulation represented in the image and the collected context information via the trained individual health model that has been trained on prior such digital images and context information; and analyzing, via the one or more processors, the one or more labeled digital images to generate a health index of the person.

Thermal tags for real-time activity monitoring and methods for fabricating the same

Li-Wen Hung and Jui-Hsin Lai
GBPatent: GB2570244B,  Publication: 2019-07-17,  Grant: 2021-05-05

Abstract

A method, a device, and a non-transitory computer readable medium for item recommendation based on visual elements. The method includes: determining, by one or more processors, visual elements from an item image of an item; generating, by the one or more processors, an element descriptor for the item based on at least a part of the visual elements; and calculating, by the one or more processors, a compatibility value between the element descriptor and one or more other element descriptors for one or more other items.

System for monitoring eating habit using a wearable device

Conglei Shi, Yinglong Xia, Jui-Hsin Lai, and Yu Ma
USPatent: US10952669B2,  Publication: 2019-06-27,  Grant: 2021-03-23

Abstract

Method and apparatus for monitoring eating behavior are disclosed. A wearable device including an imaging sensor, an electromyography (EMG) sensor, and a processing unit is configured to collect EMG data via the EMG sensor, transmit the EMG data to a computing device, receive a control signal to capture one or more images via the imaging sensor, capture, one or more images, and transmit the one or more images. A computing device is disclosed including a processor and a memory containing a machine learning model and computer program code that, when executed, performs an operation. The operation includes receiving EMG data, processing the EMG data as input to a trained machine learning model, transmitting the control signal to capture one or more images via the imaging sensor, receiving the one or more images, and determining nutritional content of the food or beverage using the one or more images.

Real-time activity monitoring using thermal tags

Li-Wen Hung and Jui-Hsin Lai
GBPatent: GB2570241B,  Publication: 2019-06-19,  Grant: 2019-11-27

Abstract

A thermal tag includes a power source to generate current along a resistive path and a plurality of infrared-emitting features positioned along the resistive path to emit infrared light along an infrared-emitting pattern, wherein the plurality of infrared-emitting features include one or more infrared-emitting stripes on a first surface of the thermal tag defining a pattern region and a plurality of infrared-emitting dots within a portion of the pattern region to provide a thermal-diffusion resistant pattern for activity monitoring.

使用热标签进行实时活动监控

Li-Wen Hung and Jui-Hsin Lai
CNPatent: CN109863469B,  Publication: 2019-06-07,  Grant: 2021-11-05

Abstract

热标签包括沿电阻路径产生电流的电源,以及沿电阻路径设置的以沿红外发射图案发射红外光的多个红外发射特征,其中多个红外发射特征包括限定图案区域的热标签的第一表面上的一个或多个红外发射条纹和图案区域的一部分内的多个红外发射点,以提供用于活动监测的抗热扩散图案。

用于实时活动监测的热标签及其制造方法

Li-Wen Hung and Jui-Hsin Lai
CNPatent: CN109844827B,  Publication: 2019-06-04,  Grant: 2021-06-01

Abstract

用于活动监测的热标签。热标签包括:基层,具有多条金属线以提供导电路径;以及图案层,具有位于导电路径的部分上方的一个或多个红外发射特征,其中至少一个红外发射特征耦合到导电路径以根据附近的活动发射预定的红外图案。

Pruning Redundant Neurons and Kernels of Deep Convolutional Neural Networks

Chun-Fu Chen, Jui-Hsin Lai, Ching-Yung Lin, Guangnan YE, and Ruichi YU
USPatent: US11093832B2,  Publication: 2019-04-25,  Grant: 2021-08-17

Abstract

Method and apparatus for optimizing a convolutional neural network (CNN). A respective measure of importance is calculated for each of a plurality of elements within a CNN. A first one of the measures of importance is calculated by back propagating a second one of the measures of importance through the CNN. One or more of the plurality of elements is pruned from the CNN, based on the calculated measures of importance.

Differential processing mechanism for spark-based graph computing background

Jui-Hsin Lai, Lifeng Nail, Toyotaro Suzumura, and Yinglong Xia
USPatent: US10936644B2,  Publication: 2019-04-04,  Grant: 2021-03-02

Abstract

A Resilient Distributed Dataset (RDD) processing method, system, and computer program product include sending a differential portion of a message from a receiver to a sender along with information of a global identifier of an RDD and differential values after matching incoming message.

Remote control with muscle sensor and alerting sensor

Jui-Hsin Lai, Lifeng Nai, Toyotaro Suzumura, and Yinglong Xia
USPatent: US10785052B2,  Publication: 2019-01-24,  Grant: 2020-09-22

Abstract

A remote control system detects a directional signal at an alerting sensor package; activates an appliance to accept a control signal in response to the directional signal; accepts the control signal at the appliance from a muscle sensor package; and adjusts operation of the appliance in response to the control signal.

一种机器人及心电检测方法

Jui-Hsin Lai and Yu Zhang
CNPatent: CN108294743B,  Publication: 2018-07-20,  Grant: 2020-09-11

Abstract

本申请实施例公开了种机器人及心电检测方法。解决现有采用便携式心电记录仪心电检测时操作不便的问题。本申请机器人包括主控单元,用于通过人机交互单元接收检测指令,根据检测指令开启机器人的检测功能;其中,检测指令用于命令机器人对目标用户进行心电检测;视觉捕捉单元,用于在机器人的检测功能开启后,获取目标用户身上的检测点的位置信息,并向主控单元发送检测点的位置信息;主控单元,还用于接收视觉捕捉单元发送的检测点的位置信息,根据检测点的位置信息移动机器人本体、机械臂以及机械手,将机械手指端的电极贴到检测点上;心电信号采集单元,用于从电极获取心电信号,对心电信号进行模数处理生成心电数据。

Surveillance d'activité en temps réel à l'aide d'étiquettes thermiques

Li-Wen Hung and Jui-Hsin Lai
WOPatent: WO2018073669A1,  Publication: 2018-04-26,  Grant: 2018-04-26

Abstract

La présente invention concerne une étiquette thermique qui comprend une source d'alimentation pour générer un courant le long d'un trajet résistif et une pluralité d'éléments émettant des infrarouges positionnés le long du trajet résistif pour émettre une lumière infrarouge le long d'un motif émettant des infrarouges, la pluralité d'éléments émettant des infrarouges comprenant une ou plusieurs bandes émettant des infrarouges sur une première surface de l'étiquette thermique définissant une région de motif et une pluralité de points émettant des infrarouges à l'intérieur d'une partie de la région de motif pour fournir un motif résistant à la diffusion thermique destiné à la surveillance d'activité.

Étiquettes thermiques pour surveillance d'activité en temps réel et procédés de fabrication associés

Li-Wen Hung and Jui-Hsin Lai
WOPatent: WO2018073686A1,  Publication: 2018-04-26,  Grant: 2018-04-26

Abstract

L'invention concerne une étiquette thermique conçue pour la surveillance d'une activité. L'étiquette thermique comprend une couche de base comportant une pluralité de lignes métalliques pour fournir un chemin conducteur, ainsi qu'une couche de motif comportant un ou plusieurs éléments d'émission infrarouge positionnés sur des parties du chemin conducteur, au moins un élément d'émission infrarouge étant couplé au chemin conducteur pour émettre un motif infrarouge prédéterminé en fonction de l'activité de proximité.

Thermal tags for real-time activity monitoring and methods for detecting the same

Li-Wen Hung and Jui-Hsin Lai
USPatent: US10311273B2,  Publication: 2018-04-19,  Grant: 2019-11-27

Abstract

A thermal tag includes a power source to generate current along a resistive path and a plurality of infrared-emitting features positioned along the resistive path to emit infrared light along an infrared-emitting pattern, wherein the plurality of infrared-emitting features include one or more infrared-emitting stripes on a first surface of the thermal tag defining a pattern region and a plurality of infrared-emitting dots within a portion of the pattern region to provide a thermal-diffusion resistant pattern for activity monitoring.

Remote control with muscle sensor and altering sensor

Jui-Hsin Lai, Lifeng Nai, Yinglong Xia, and Toyotaro Suzumara
USPatent: US10084612B2,  Publication: 2018-04-05,  Grant: 2018-09-25

Abstract

A remote control system detects a directional signal at an alerting sensor package; activates an appliance to accept a control signal in response to the directional signal; accepts the control signal at the appliance from a muscle sensor package; and adjusts operation of the appliance in response to the control signal

Detecting oral temperature using thermal camera

Jui-Hsin Lai, Blaine H. Dolph, Ching-Yung Lin, and David M. Lubensky
USPatent: US9962093B2,  Publication: 2018-03-29,  Grant: 2018-05-08

Abstract

A method, system, and computer product for detecting an oral temperature for a human include capturing a thermal image for a human using a camera having a thermal image sensor, detecting a face region of the human from the thermal image, detecting a mouth region on the face region, detecting an open mouth region on the mouth region, detecting a degree of mouth openness on the detected open mouth region, determining that the degree of mouth openness meets a predetermined criterion, and detecting the oral temperature, responsive to determining that the degree of mouth openness meets the predetermined criterion.

Trace/trajectory reconstruction via wearable and/or mobile sensors for indoor/outdoor location

Jui-Hsin Lai, Lifeng Nai, Toyotaro Suzumura, and Yinglong Xia,
USPatent: US10136265B2,  Publication: 2018-03-15,  Grant: 2018-11-20

Abstract

At a mobile electronic device, first sensor data is obtained from at least one wearable muscle sensor, suggesting that location tracking will imminently be desirable. A first indication that an external locator signal is not usable is also obtained. Responsive to the first sensor data and the indication, second sensor data, from at least one wearable muscle sensor, indicative of motion of a subject wearing the at least one muscle sensor, is recorded. A second indication that the external locator signal is now usable is obtained. Responsive to the second indication, the external locator signal is used to determine a current location of the mobile electronic device; and the second sensor data is sued to backtrack from the current location of the mobile electronic device to indicate a location of the mobile electronic device at a time when the recording of the second sensor data was initiated.

Authentication for device connection using visible patterns

Chia-Yu Chen, Li-Wen Hung, Jui-Hsin Lai, and Ko-Tao Lee
USPatent: US10251057B2,  Publication: 2018-03-01,  Grant: 2019-04-02

Abstract

Wireless communication is established between electronic devices by an initiating device transmitting a wireless communication request to a peripheral device; the initiating device detecting a visible electromagnetic pattern displayed on the peripheral device in response to the wireless communication request; the initiating device decoding the visible electromagnetic pattern to generate a passcode; and the initiating device echoing the passcode to the peripheral device to authenticate the wireless communication request without user intervention.

Multiple unmanned aerial vehicle autonomous coordination

Jui-Hsin Lai, Yu Ma, Conglei Shi, and Yinglong Xia
USPatent: US10120377B2,  Publication: 2018-02-15,  Grant: 2018-11-16

Abstract

At each of a plurality of unmanned aerial vehicles operating in a three-dimensional space, current relative locations of other ones of the plurality of unmanned aerial vehicles which are visible to each of the plurality of unmanned aerial vehicles are determined based on two-dimensional camera images from on-board dual-lens cameras. The current relative locations are wirelessly transmitted to a controller. At the plurality of unmanned aerial vehicles, specification of a path to be followed by each of the plurality of unmanned aerial vehicles is wirelessly received from the controller. At each of the plurality of unmanned aerial vehicles, on-board collision avoidance is carried out based on the two-dimensional camera images from the on-board dual-lens cameras, while following the path specification.

True random generator (trng) in ml accelerators for NN dropout and initialization

Chia-Yu Chen, Pierce I-Jen Chuang, Li-Wen Hung, and Jui-Hsin Lai
USPatent: US10579583B2,  Publication: 2018-02-15,  Grant: 2020-03-03

Abstract

A random number signal generator used for performing dropout or weight initialization for a node in a neural network. The random number signal generator includes a transistor which generates a random noise signal. The transistor includes a substrate, source and drain regions formed in the substrate, a first insulating layer formed over a channel of the transistor, a first trapping layer formed over the first insulating layer, a second insulating layer formed over the first trapping layer, and a second trapping layer formed over the second insulating layer. One or more traps in the first and second trapping layers are configured to capture or release one or more carriers flowing through the channel region. The random noise signal is generated as a function of one or more carrier being captured or released by the one or more traps.

Method and apparatus to identify a live face image using a thermal radiation sensor and a visual radiation sensor

Jui-Hsin Lai, Chia-Yu Chen, Pierce I-Jen Chuang, and Li-Wen Hung
USPatent: US9886640B1,  Publication: 2018-02-06,  Grant: 2018-02-06

Abstract

A method, system and computer program product are disclosed that comprise capturing first image data of a person's face using at least one sensor responsive in a band of infrared wavelengths and capturing second image data of the person's face using the at least one sensor responsive in a band of visible wavelengths; extracting image features in the image data and detecting face regions; applying a similarity analysis to image feature edge maps extracted from the first and the second image data; and recognizing a presence of a live face image after regions found in the first image data pass a facial features classifier. Upon recognizing the presence of the live face image, additional operations can include verifying the identity of the person as an authorized person and granting the person access to a resource.

Method, system and computer program product configured to protect documents to be captured in camera preview

Jui-Hsin Lai, Wan-Yi Lin, and Ching-Yung Lin
USPatent: US10701261B2,  Publication: 2018-02-01,  Grant: 2020-06-30

Abstract

A method includes analyzing a preview image made by an image sensor when operating in a preview image mode to determine if the preview image contains some portion that corresponds to information that is considered not subject to being imaged. The method further includes, if it is determined that the preview image does comprise some image portion that corresponds to information that is considered not subject to being imaged, disabling the image sensor from capturing an image that would correspond to the preview image. Analyzing can include accessing a data storage that contains representations of information that is considered not subject to being imaged for comparison with image features extracted from the preview image, where the data storage is at least one of contained in a device that also contains the image sensor, or is located remotely from the device and can be accessed via a wireless connection.

Method, system and computer program product for selective image capture

Jui-Hsin Lai, Ching-Yung Lin, and Wan-Yi Lin
USPatent: US10701261B2,  Publication: 2018-02-01,  Grant: 2020-06-30

Abstract

A method includes analyzing a preview image made by an image sensor when operating in a preview image mode to determine if the preview image contains some portion that corresponds to information that is considered not subject to being imaged. The method further includes, if it is determined that the preview image does comprise some image portion that corresponds to information that is considered not subject to being imaged, disabling the image sensor from capturing an image that would correspond to the preview image. Analyzing can include accessing a data storage that contains representations of information that is considered not subject to being imaged for comparison with image features extracted from the preview image, where the data storage is at least one of contained in a device that also contains the image sensor, or is located remotely from the device and can be accessed via a wireless connection.

Graph-based online image queries

Jui-Hsin Lai, Yinglong Xia, Lifeng Nai, and Ching-Yung Lin
USPatent: US11120069B2,  Publication: 2018-01-25,  Grant: 2021-09-14

Abstract

A query image is obtained. In a database including a plurality of reference image graphs, at least one of the reference image graphs, with feature vectors similar to the query image, is identified. Image querying is carried out by graph traversal on the at least one of the reference image graphs with the feature vectors similar to the query image. An image from the at least one of the reference image graphs having a highest matching score in the graph traversal is returned as a response to the query image. techniques for building the database are also disclosed.

Graph method for system sensitivity analysis

Yinglong Xia, Jui-Hsin Lai, Pei-Yun Hsueh, and Chia-Yu Chen
USPatent: US10552486B2,  Publication: 2017-11-30,  Grant: 2020-02-04

Abstract

A computer-implemented method, computer program product, and system for determination of critical parts and component correlations in a circuit using a correlation graph and centrality analysis including; receiving a circuit layout portion of a larger circuit layout, converting the circuit layout portion into a correlation graph representing components as nodes and connecting wires as edges, determining, using ground truth and Naïve Bayes to determine correlation weighting, scaling the correlation graph to represent the larger circuit, and presenting the larger correlation graph on a graphical user interface (GUI).

Graph method for system sensitivity analyses

Chia-Yu Chen, Pei-Yun Hsueh, Jui-Hsin Lai, and Yinglong Xia
USPatent: US10552486B2,  Publication: 2017-11-30,  Grant: 2020-02-04

Abstract

A computer-implemented method, computer program product, and system for determination of critical parts and component correlations in a circuit using a correlation graph and centrality analysis including; receiving a circuit layout portion of a larger circuit layout, converting the circuit layout portion into a correlation graph representing components as nodes and connecting wires as edges, determining, using ground truth and Naïve Bayes to determine correlation weighting, scaling the correlation graph to represent the larger circuit, and presenting the larger correlation graph on a graphical user interface (GUI).

Wearable sensor based system for person identification

Yinglong Xia, Jui-Hsin Lai, Lifeng Nai, and Toyotaro Suzumara
USPatent: US9769166B1,  Publication: 2017-09-19,  Grant: 2017-09-19

Abstract

A system, method and computer program product for real-time recognition of individuals. The method comprises: receiving at a hardware processor, a first sensor data associated with the individual. The first sensor data associated with the individual is processed to determine an activity the individual is currently engaged in. Additionally, a second sensor data associated with the individual is received and processed to determine a feature associated with a muscle of said individual while engaged in activity. Based on the received sensor data and determined activity and muscle features, the method generates a model that correlates determined activities and corresponding muscle features of the individual user with the individual's identity. The model is subsequently used to identify the individual. By receiving and inputting real-time, sensor data from an individual into said generated model, the model generates and determines: an activity and a muscle feature for use in identifying the individual.

Automatic painting system with drone, user interface and computer vision

Jui-Hsin Lai, Yu Ma, Conglei, Shi, and Yinglong Xia
USPatent: US10023311B2,  Publication: 2017-09-14,  Grant: 2018-07-17

Abstract

A system and method for painting a structure. The system comprises: a computer vision processing system configured to obtain images of a target structure and generate first instructions signals for real time communication to an unmanned aerial vehicle (UAV) having a paint fluid dispensing system provided thereon; a control device at the UAV responsive to received the first instruction signals for controlling real time navigating of the UAV to a location at the target structure; and the computer vision processing system configured to generate second instruction signals for real time communication to the UAV, wherein the control device at the UAV is configured to automatically actuate the paint fluid dispensing system to apply a paint fluid at the location on the target structure in response, the received second instruction signals configuring the UAV to render a desired visual image on the target structure.

Identity recognition with living signatures from multiple devices

Jui-Hsin Lai and Yinglong Xia
USPatent: US10277595B2,  Publication: 2017-06-15,  Grant: 2019-04-30

Abstract

Identity recognition is achieved using user's living signatures, such as a heartbeat signal, from multiple devices. A user requests identity recognition for using a first registered device, such as a mobile device. The request is provided to a cloud. When the cloud confirms the mobile device is a registered device, the cloud directs the first registered device to upload the user living signature to the cloud. The cloud also sends a request to a user second registered device to upload the user living signature from the second registered device to the cloud. The user second registered device may be a headband monitor, watch, Google glasses, or the like capable of monitoring and uploading the user living signature to the cloud. The cloud compares both living signature signals from the first registered device and from the second registered device. If the signals are matched, the user identity is confirmed. If the signals are not matched, the user identity is not confirmed. Preferably the first registered device is a mobile device.

Graph-based analysis for bio-signal event sensing

Chia-Yu Chen, Pei-Yun S. Hsueh, Jui-Hsin Lai, and Yinglong Xia
USPatent: US10282875B2,  Publication: 2017-06-15,  Grant: 2019-05-07

Abstract

One or more biological signals are obtained. The one or more biological signals are converted to one or more graph structures. Correlation between two or more of the biological signals are determined using the one or more graph structures. One or more changes in the one or more graph structures within a time window are recorded. A signal graph model is generated based on the recorded changes.

Monolithic integration of a III-V optoelectronic device, a filter and a driving circuit

Chia-Yu Chen, Li-Wen Hung, Jui-Hsin Lai, and Ko-Tao Lee
USPatent: US9653441B1,  Publication: 2017-05-16,  Grant: 2017-05-16

Abstract

After forming an opening extending through a (100) silicon layer and a buried insulator layer and into a (111) silicon layer of a semiconductor-on-insulator (SOI) substrate, a light-emitting element is formed within the opening. A portion of the (111) silicon layer located beneath the light-emitting element is patterned to form a patterned structure for tuning light emission characteristics and enhancing efficiency of the light-emitting element. Next, at least one field effect transistor (FET) is formed on the (100) silicon layer for driving the light-emitting element.

Social system and method used for bringing virtual social network into real life

Jui-Hsin Lai, Shao-Yi Chien, Jhe-Yi Lin, Min-Yian Su, Po-Chen Wu, and Chieh-Chi Kao,
USPatent: US9329677B2,  Publication: 2016-05-03,  Grant: 2016-05-03

Abstract

The present invention is related to a social system and process used for bringing virtual social network into real life, which is allowed for gathering and analyzing a social message of at least one interlocutor from virtual social network so as to generate at least one recommended topic, allowing a user to talk with the interlocutor through the utilization of the recommended topic, and then capturing and analyzing at least one speech and behavior and/or physiological response of the interlocutor during talking so as to generate an emotion state of the interlocutor. The user is allowed to determine whether the interlocutor is interested in the recommended topic through the emotion state of interlocutor. Thus, it is possible to bring the social message on virtual network into real life, so as to increase communication topics between persons in real life.

影像追蹤裝置及其影像追蹤方法

Jui-Hsin Lai and Ja-Ling
TWPatent: TWI496114B,  Publication: 2014-06-01,  Grant: 2015-08-11

Abstract

本發明提供一種影像追蹤裝置及其影像追蹤方法。更具體而言,本發明提供一種關於具有記憶及學習功能之影像追蹤裝置及其影像追蹤方法。

Image Tracking Device and Image Tracking Method Thereof

Jui-Hsin Lai and Ja-Ling
USPatent: US9105101B2,  Publication: 2014-05-29,  Grant: 2015-08-11

Abstract

An image tracking device and an image tracking method thereof are provided. The image tracking device includes an image capture interface, a storage means, and a processor means. The storage means has a multi-dimensional storage space for storing a plurality of first images, each dimension of the multi-dimensional storage space being corresponding to a feature-related variance of a multi-dimensional variance. The processor means is configured to execute the following operations: marking a second image in the picture frame; calculating a multi-dimensional variance between the second image and each of the first images separately; determining whether the second image contains the object according to the multi-dimensional variance calculated; and if the second image is determined as one containing the object, storing the second image as one of the first images, in a specific subspace of the multi-dimensional storage space according to the multi-dimensional variance calculated.

用以將虛擬的社交網路帶入至真實生活中之社交系統及方法

Jui-Hsin Lai, Shao-Yi Chien, Jhe-Yi Lin, Min-Yian Su, Po-Chen Wu, and Chieh-Chi Kao,
TWPatent: TWI482108B,  Publication: 2013-07-01,  Grant: 2015-04-21

Abstract

本發明有關於一種用以將虛擬的社交網路帶入至真實生活中之社交系統及方法,尤指一種可利用虛擬網路的社交訊息來增加真實生活人與人之間的溝通話題之社交系統及方法。

與影片互動之方法與比賽模擬系統

Jui-Hsin Lai and Shao-Yi Chien
TWPatent: TWI454140B,  Publication: 2011-12-16,  Grant: 2014-09-21

Abstract

一種與影片互動之方法,其藉由至少一動態偵測裝置與一影片進行互動。該方法之步驟包括:首先,執行一影片內容分解程序,用以將該影片分解出一背景場景以及複數個前景物件;接著,依據上述前景物件的狀態來分類成至少一事件資料庫;最後,根據動態偵測裝置所偵測到的動態,從事件資料庫中選出適當的前景物件來顯示。其中,上述前景物件會依據動態偵測裝置所偵測到的動態依序顯示於背景場景上。

Method for Interacting with A Video and Game Simulation System

Jui-Hsin Lai and Shao-Yi Chien
USPatent: US20110300933A1,  Publication: 2011-12-08

Abstract

A method for interacting with a video by a motion detector is disclosed. First, a video-content-decomposition procedure is executed to decompose the video into a background scene and at least one foreground object. Then, at least one event database is classified according to the state of the foreground object. Finally, the suitable foreground objects are selected from the event database according to a detected motion by the motion detector. Wherein, the foreground objects selected are rendered on the background scene sequentially according to the detected motion.

可根據頻寬速率調整影片內容的方法

Jui-Hsin Lai and Shao-Yi Chien
TWPatent: TWI378718B,  Publication: 2010-12-16,  Grant: 2012-12-01

Abstract

本發明有關於一種可根據頻寬速率調整影片内容的方 法&本發明係可根據頻寬速率調整影片内容,以提供不同 的衫片串流大小,如此,在低頻率速率下,觀賞者仍可欣 賞到高晝質的影片。

Method for scaling video content based on bandwidth rate

Jui-Hsin Lai and Shao-Yi Chien
USPatent: US8306109B2,  Publication: 2010-12-09,  Grant: 2012-11-06

Abstract

A method for scaling video content based on bandwidth rate is disclosed. Wherein, a plurality of target shots and non-target shots are recognized from shots of a video. A background and at least one foreground object are separated from the video frame of the target shot. The present invention method provides a plurality of bandwidth levels, and one among them is selected in advance. At least one foreground object is selected and pasted on the background based on the selected bandwidth level, so as to obtain at least one recombined target shot. The recombined target shot, the non-target shot or other recombined target shot can be merged to form a recombined video unit based on the selected bandwidth level. Therefore, the present invention proposes video content of scalability based on bandwidth rate to provide the different video bit-stream size, so that viewer can get the high quality video under the lower bandwidth rate.

影片內容分解與生成方法及其操作的使用者介面

Jui-Hsin Lai and Shao-Yi Chien
TWPatent: TWI372561B,  Publication: 2010-10-16,  Grant: 2012-09-11

Abstract

本發明有關於一種影片內容分解與生成方法及其操作之使用者介面,首先,在一影片中識別出複數個目標鏡頭,並以各目標鏡頭的播放時間為基準點將影片分割成複數個影片單元,接著,目標鏡頭之影片畫面中分解出一背景場景及至少一前景物件,在背景場景上進行編輯以產生豐富的視覺效果,而藉由分析前景物件的資訊,以了解各影片單元的影片內容,並對於各影片內容進行註解,而後,使用者介面任意重組前景物件於背景場景上,以產生客製化的影片內容,致使影片的觀賞者可得到更多的觀看樂趣。

Method for decomposition and rendering of video content and user interface for operating the method thereof

Jui-Hsin Lai and Shao-Yi Chien
USPatent: US8300894B2,  Publication: 2010-10-07,  Grant: 2012-10-30

Abstract

A method for decomposition and rendering of video content and user interface for operating the method thereof is disclosed. First, a plurality of target shots are recognized from a video, the video is decomposed into a plurality of video units based on the playtime of each target shot. Then, the video frame of target shot is decomposed into a background scene and at least one foreground object. The editing process is performed on the background to generate the plentiful visual effect. The video content of each video unit is known by analyzing the information of the foreground object, and therefore each video unit can be annotated. Furthermore, the user interface reintegrates the foreground object in the background scene and generates the customized video content according to users' request, so that viewers may get more enjoyment on game watching.