The present invention discloses a smart counting method and system in manufacturing, specifically in custom clothing or fabric manufacturing. The smart counting method and system uses a camera to feed real-time image data of a working platform where a worker takes a unfinished clothing or fabric, processes the clothing or fabric, and puts the finished clothing or fabric in a finished pile to a processing unit. The processing unit automatically starts a new work order and counts the number of finished products in this work order by using computer vision techniques.
|
11. A method for smart counting in manufacturing, comprising:
configuring a platform including an input area for accommodating a stack of unfinished products, a workspace where a worker processes the unfinished products one by one, and an output area for accommodating a stack of finished products;
configuring a first tag in the workspace, the first tag being obscured when the worker is processing an unfinished product in the workspace;
configuring a second tag in the output area, the second tag being obscured when the output area holds one or more finished products;
determining that an unfinished product in the workspace matches a predetermined pattern and initializing a work count;
checking whether the first tag has been obscured for at least a predetermined time period;
detecting a motion in the output area;
in response to that the first tag has been obscured for at least the predetermined time period and a motion is detected in the output area, increasing the work count; and
repeating checking whether the first tag has been obscured for at least the predetermined time period and increasing the work count in response to that the first tag has been obscured for at least the predetermined time period and a motion is detected in the output area until that the second tag is detected in the output area.
1. A smart counting system in manufacturing, comprising:
a platform configured to have three areas including an input area for accommodating a stack of unfinished products, a workspace where a worker processes the unfinished products one by one, and an output area for accommodating a stack of finished products;
a first tag positioned in the workspace, the first tag being obscured when the worker is processing an unfinished product in the workspace;
a second tag positioned in the output area, the second tag being obscured when the output area holds one or more finished products;
a camera configured above the platform and pointing down to the platform, wherein the camera captures real-time image data including data of the workspace and output area; and
a processing unit for receiving and processing the real-time image data from the camera and executing a process based on the real-time image data, the process comprising the following steps:
determining that an unfinished product in the workspace matches a predetermined pattern and initializing a work count,
checking whether the first tag has been obscured for at least a predetermined time period,
detecting a motion in the output area,
in response to that the first tag has been obscured for at least the predetermined time period and a motion is detected in the output area, increasing the work count, and
repeating checking whether the first tag has been obscured for at least the predetermined time period and increasing the work count in response to that the first tag has been obscured for at least the predetermined time period and a motion is detected in the output area until that the second tag is detected in the output area.
2. The system of
3. The system of
4. The system of
5. The system of
6. The system of
8. The system of
9. The system of
10. The system of
12. The method of
13. The method of
14. The method of
15. The method of
16. The method of
17. The method of
18. The method of
19. The method of
20. The method of
|
|||||||||||||||||||||||||||||
This application claims priority to U.S. provisional patent application Ser. No. 62/969,764, filed Feb. 4, 2020, the entire content of which is incorporated herein by reference.
This invention generally relates to automating the product counting process in custom manufacturing, specifically to the counting of finished products (e.g., clothes) in a factory.
Custom manufacturing is becoming more and more important to meet consumers' personalized design needs. For example, custom clothing manufacturing (“CCM”) is becoming a trend in the clothing industry. A CCM factory takes orders from customers with varied designs, makes the clothes according to the designs, and delivers the finished goods in a very short turnaround time. CCM generally processes a lot more orders than traditional apparel manufacturing, although each order in CCM is generally much smaller. Thus, a CCM manufacturing line needs to handle order changes frequently. Each change may require reconfiguration of the equipment or work settings, causing machine and labor downtime and loss of productivity.
In addition, CCM customers are more likely to demand live, accurate reports on the progress of their orders. For example, a customer may want to keep a live count of the number of completed pieces of clothing. Workers on the CCM manufacturing line need to perform extra acts (e.g., pressing a button for finishing each piece of clothing) to collect live data.
Such problems also exist in custom fabric printing or similar manufacturing scenarios.
The present invention discloses a smart counting method and system in manufacturing, such as custom clothing manufacturing or custom fabric printing. In one embodiment, the smart counting system includes a platform configured to have three areas including an input area for accommodating a stack of unfinished products (e.g., clothing, fabric), a workspace having a first tag positioned on the workspace, and an output area having a second tag positioned on the output area. The smart counting system further includes a camera configured above the platform and points down to the platform. A processing unit receives and processes real-time image data from the camera. Initially, when the processing unit detects a piece of clothing or fabric in the workspace, and the clothing or fabric matches a pattern from a design database, the processing unit starts a new work count. If the first tag in the workspace has been obscured for more than a predetermined time period (e.g., because the worker is processing the unfinished clothing or fabric), and if the processing unit detects a motion in the output area, it increases the work count. The processing unit repeats the previous step until it detects the second tag in the output area (in which case, it means that the worker has taken away the finished product stack). Then, the process returns to the initial point and may start a new work count if it detects a new design in the workspace.
The subject matter, which is regarded as the invention, and other features and also the advantages of the invention will be apparent from the following detailed description taken in conjunction with the accompanying drawings.
The system 100 also includes two tags: tag 121 is placed in the middle of the workspace and tag 122 is placed in the output area. Any types of fiducial markers, such as AprilTag, or tags described in U.S. patent application Ser. Nos. 16/566,892, 16/748,292, may be used in system 100. In addition, barcodes or even simple drawings may be used in system 100 as long as they can be uniquely identified in system 100. The system uses these tags to decide where the workspace and output areas are. This is done by using each tag as the center point of the area and sizing the area to a consistent, configurable value. Specifically, the system may use each tag as the center point and define a bounding box as the workspace or output area. The size of the bounding box may be adjusted manually to accommodate the actual condition in the factory. The bounding box for the workspace should be large enough to contain a product of a spread-out clothing or fabric. Ideally, the tags are printed about the size of a letter-size paper and printed in dark ink so that they could be recognized by cameras easily, even from a distance. Tag 121 should be placed where it would be obscured when a worker is processing a piece of clothing or fabric in the workspace, and tag 122 should be placed where it would be obscured after a worker places a finished clothing or fabric in the output area. The output area should be far enough away from the workspace area to avoid accidental activity in the output area while the worker is folding clothes.
The system 100 further includes a processing unit 103 for processing images from the camera 102 and performing the counting process as described in detail below in reference to
In addition, the system 100 may include a monitoring terminal 104, which allows a system administrator to configure the counting process, setup and configure the camera, configure the bounding boxes for the workspace and output area, etc. In one embodiment, the processing unit 103 and the monitoring terminal 104 may be a single unit or machine serving both functions. Alternatively, the processing unit 103 and the monitoring terminal 104 may be separate devices that can communicate wired or wirelessly. Also, the monitoring terminal 104 may communicate with the camera 102 directly or through the processing unit 103. In one embodiment, the monitoring terminal 104 may be a personal computer, a tablet computer, or a smartphone.
In one embodiment, before work starts, a factory uploads images of all clothing or fabric designs that will be worked on for that session. For example, the images may be uploaded to the processing unit 103 from a monitoring terminal 104 by a system administrator. Each clothing or fabric design corresponds to a ticket. These reference images will be used later to decide which ticket is currently being worked on. Specifically, a reference picture may be taken for each clothing or fabric design as a ticket. Ideally, the clothing or fabric should be behind a neutral background without excessive detail. The more similar the reference image environment is to the workspace environment, the better the results. The reference picture is then cropped to include only the clothing or fabric.
In State 2, the process waits for the workspace tag 121 to be obscured for at least a configurable period of time (e.g., 0.5 seconds), preferably corresponding to the worker's folding and processing time for each clothing or fabric. Then, the process enters State 3. The configuration period of time is needed to avoid double-counting work or interpreting unrelated movements as work (e.g., a shadow passing across the output area).
In State 3, the process waits for motion at the output area, where motion is detected using a set of simple computer vision operations (e.g., by using OpenCV—a library of programming functions mainly aimed at real-time computer vision—and comparing two frames of images to determine whether there is significant difference). When motion is detected, the work count is incremented for the active ticket. Then, the process enters State 4.
In State 4, the process waits for the workspace tag 121 to be obscured for at least a configurable period of time. This state is identical to State 2 except that the process enters State 5 once this condition has been met.
In State 5, the process waits on two separate conditions. If motion is found at the output area, the work count is incremented for the active ticket and the process goes back to State 4. Alternatively, if the output tag 122 is detected, the process goes to State 1. This means that if the worker wants to switch to a different ticket, the worker needs to clear the clothing or fabric pile at the output area to signal that the current ticket is done.
Thus, although specific embodiments of the invention have been disclosed, those having ordinary skill in the art will understand that changes can be made to the specific embodiments without departing from the spirit and scope of the invention. The scope of the invention is not to be restricted, therefore, to the specific embodiments. Furthermore, it is intended that the appended claims cover any and all such applications, modifications, and embodiments within the scope of the present invention.
Thiel, Alexander, Li, Xintian, Compton, Tyler, Beagle, Bryce
| Patent | Priority | Assignee | Title |
| Patent | Priority | Assignee | Title |
| 5165007, | Feb 01 1985 | International Business Machines Corporation | Feneme-based Markov models for words |
| 20040008269, | |||
| 20060217232, | |||
| 20090063307, | |||
| 20130140354, | |||
| 20160379031, | |||
| 20180293543, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| Jun 11 2024 | THIELE, ALEX | DILILI LABS, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 068598 | /0741 | |
| Jun 17 2024 | COMPTON, TYLER | DILILI LABS, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 068598 | /0741 | |
| Jun 22 2024 | BEAGLE, BRYCE | DILILI LABS, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 068598 | /0741 | |
| Jul 06 2024 | LI, XINTIAN | DILILI LABS, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 068598 | /0741 |
| Date | Maintenance Fee Events |
| Feb 04 2021 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
| Feb 17 2021 | SMAL: Entity status set to Small. |
| Date | Maintenance Schedule |
| Mar 14 2026 | 4 years fee payment window open |
| Sep 14 2026 | 6 months grace period start (w surcharge) |
| Mar 14 2027 | patent expiry (for year 4) |
| Mar 14 2029 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Mar 14 2030 | 8 years fee payment window open |
| Sep 14 2030 | 6 months grace period start (w surcharge) |
| Mar 14 2031 | patent expiry (for year 8) |
| Mar 14 2033 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Mar 14 2034 | 12 years fee payment window open |
| Sep 14 2034 | 6 months grace period start (w surcharge) |
| Mar 14 2035 | patent expiry (for year 12) |
| Mar 14 2037 | 2 years to revive unintentionally abandoned end. (for year 12) |