An interactive system and a method of use for treatment and training a person with asd or a similar condition or problem including primary part of holograms and holographic assistant, and secondary part of a group of drones and a robot that involves the use of a pair of holograms that imitate and demonstrate the functions of the right hemisphere of the brain and the left hemisphere of the brain, the exchange of information between them through the communication between the two. The interactive system can be used in training humanoid robots.
|
1. An interactive system for the treatment and training of a participant with autism spectrum disorder (asd), characterised in that the interactive system includes interactive elements comprising:
a hologram, in a size ratio of approximately 1:1 with a participant;
a holographic assistant, duplicate the hologram, proportionally smaller than the hologram;
a humanoid robot; and
a group of drones;
and a software management system.
11. A method for use of interactive system for treatment and training of a participant with asd, characterised in that said method comprises employing an interactive system comprising interactive elements including
a hologram, in a size ratio of approximately 1:1 with the participant,
a holographic assistant, duplicate hologram, of a smaller size than the first hologram;
at least one helping hologram depending on the activity and/or therapy;
a humanoid robot; and
a group of drones; and
a software management system,
further comprising operating the interactive system with computer specialists under the direction of a medical specialist.
2. The interactive system of
3. The interactive system of
4. The interactive system of
5. The interactive system of
6. The interactive system of
7. The interactive system of
9. The interactive system of
10. The interactive system of
12. The method of
13. The method of
interaction between any two of said elements;
interaction between any three of said elements; and
interaction between all of said elements.
14. The method of
15. The method of
(i) preparing the interactive system;
(ii) performing initial preparation of the participant;
(iii) preparing the participant for starting individual activities and therapies; and
(iv) preparing the participant for group activities and therapies.
|
|||||||||||||||||||||||
The present application is in the field of treatment and training of people with autism spectrum disorders.
More specifically, the present invention relates to an interactive system comprising a hologram, a holographic assistant, a group of drones and a robot, and a method of use in treatment and training of people with autism spectrum disorders and similar conditions and problems.
The interactive system may be used for training for humanoid robots.
ASD is a lifelong developmental disability that affects how people perceive the world and interact with others. It affects more than 1 in 100 people and is commonly diagnosed in childhood, with boys being four times more likely to be diagnosed than girls. ASD is a spectrum condition, affecting people in different ways. Common characteristics are difficulties with social communication and interaction, and repetitive behaviour, routines and activities, to the extent that everyday functioning is limited and impaired. For example, people with ASD have difficulties with interpreting both verbal and non-verbal language, like gestures or tone of voice. Some may not speak or have limited speech capabilities. Some may prefer to use, or need to use, alternative means of communication, such as sign language or visual symbols. With regard to social interactions, there is often difficulty in recognising or understanding others' feelings and intentions, and in expressing their own emotions. People with ASD can therefore appear to be insensitive or be perceived as socially awkward and may find it hard to form friendships. The American Diagnostic and Statistical Manual (DSM) specifies three levels of severity in relation to social communication impairments and restricted, repetitive patterns of behaviour, namely: requiring support; requiring substantial support; requiring very substantial support.
People with ASD may also experience over- or under-sensitivity to sounds, touch, tastes, smells, light, colours, temperatures or pain. For example, they may find certain background sounds unbearably loud or distracting, and this can lead to anxiety or even physical pain.
ASD is not a disease and cannot be ‘cured’. However, there is a variety of treatments, including different therapies, methods and activities designed to improve speech and behaviour, such as Floortime therapy; The “Blue Room” system; Method of Prof. Dr. Harry Schneider; Treatment Method of Roberto Morales; Autism treatment with Indian Ayurveda medicine—use of herbs; Chinese medicine—autism is treated with acupuncture with herbal supplements; Stem Cells as Autism Therapy; Dr. Stephen Edelson—Psychologist—the PECS—Alternate Card Communication System; Alternative therapies and activities—some of which are but not limited to: Music therapy, Biofeedback, Drum therapy, Ergo therapy, Hydro therapy, Art therapy, Hippo therapy, Kanis therapy, Feline therapy, Hyperbaric Oxygen therapy, Honey therapy, Sand therapy, Aromatherapy, activities in gardening, cooking, pastry.
Despite the wide range of existing exercises, therapies and methods used in combination or separately for the treatment of autism, there is no lasting result.
The present invention relates to an interactive system and method of use for treatment and training a person with ASD or a similar condition or problem, through the use of a pair of holograms that imitate and demonstrate the functions of the right hemisphere of the brain and the left hemisphere of the brain, the exchange of information between them through communication between the two.
References herein to ‘ASD’ mean not only ASD but related and/or similar conditions and problems.
The method employs an interactive system for a person with ASD (a participant), the interactive system comprising a number of interactive elements including
operated by computer specialists using a computer software management system and directed by a medical specialist.
The method further employs a therapy space for a person with ASD, wherein interactive elements as described above are arranged spatially in relation to the participant. This therapy space is safe for the participant.
Both the interactive system and the therapy space are aspects of the invention as described herein.
In one aspect, the present invention provides a method for training the brain of a participant, which method employs an interactive system comprising interactive elements including
operated by computer specialists using a computer software management system and directed by a medical specialist.
In the method of the present invention, the pair of holograms imitate and demonstrate the functions of the right hemisphere of the brain and the left hemisphere of the brain and the communication between the two.
The method of the present invention may employ a ‘helping’ hologram, as described in more detail herein.
In implementation of the method, a coach may be employed to assist a participant in his or her participation in tasks and activities delivered by the interactive system, as described in more detail herein.
By ‘coach’ a specialist with a professional qualification in the respective field of a given activity or therapy. For example, a hypo-therapy instructor is trained to work with horses and carry out the hypo-therapy activities for the particular participant. In addition to the professional qualification, he or she will generally have an additional qualification such as a psychotherapeutic and/or psychological qualification for working with a person with ASD.
By ‘medical specialist’ is meant psychiatrist (doctor of psychiatry). The psychiatrist can work either individually or in a team with other professionals, such as a psychologist, speech therapist or other specialists, depending on need and the condition of the participant.
The interactive system employed in the present invention also forms part of the present invention.
Thus, in another aspect, the present invention provides an interactive system for a participant, characterised in that the interactive system comprises interactive elements including
As above, the interactive system is operated by computer specialists using a computer software management system and directed by a medical specialist, and a coach may be.
In a further aspect, the present invention provides a therapy space for a participant, characterised in that said therapy space contains interactive elements including
each of said interactive elements being arranged spatially in relation to the participant.
In correspondence with the above, the actions and interactions of the interactive elements are operated by computer specialists using a computer software management system and directed by a medical specialist.
The following discussion applies to all aspects of the present invention and no statement is to be regarded as limiting of the invention.
People with ASD are very visual. They do not understand the meaning of the word “imagine” therefore there are two holograms that imitate the function of the human brain.
In some embodiments, the first hologram is adapted to stimulate the left hemisphere of the brain and the conscious. The first hologram may help a participant with self-acquaintance and self-acceptance and to self-like.
Thus, the hologram may be of approximately the same size as the participant and may be created in his or her image. The hologram may reflect the physical appearance of the user, and optionally also his or her characteristic speech, movement and behavioural traits. In this embodiment the hologram is a mirror image of the participant and in use of the system of the present invention, the participant will see him- or herself in the hologram and see that he or she can perform a given task, say given words, and make particular choices.
The hologram will generally be positioned to the left side of the participant and, depending on the participant's height, at a distance of 1.5 to 2.5 metres from the participant.
In some embodiments, the hologram is created with a different physical appearance to the user. For example, if the participant is seen to initially not like, or be uncomfortable with, a hologram in his or her own image, a hologram with a different physical appearance (an ‘altered hologram’) may be used initially, to be accepted.
The holographic assistant is a duplicate hologram and may also be referred to herein as a ‘holographic assistant’. In some embodiments, the holographic assistant is adapted to imitate the function of right hemisphere of the brain and the subconscious. The holographic assistant is a connecting part of the hologram and the participant. Initially it displaced the participant to show him or her what to do. The holographic assistant may promote self-confidence and self-understanding in a participant, and faith in his or her capabilities.
Thus, the holographic assistant may be identical to the first hologram in every way apart from in size; it therefore also has the image of the user and reflects the physical appearance of the user, and optionally also his or her characteristic speech, movement and behavioural traits, but may be have a size ratio of, for example, 0.08-0.15:1 with the user.
The holographic assistant will generally be positioned to the right side of the participant and, depending on the participant's height, at a distance of 0.5 to 1.0 metre from the participant. It is deliberately smaller because the subconscious and the feelings cannot be seen.
In other embodiments, the holographic assistant may have an appearance different to that of the hologram. As above, this may be necessary when the participant is seen to not like, or be uncomfortable with, a hologram in his or her own image.
The relative sizes and positionings of the first hologram and assistant hologram with the participant reflect their respective roles in relation to the left hemisphere of the brain and logic (hologram) and right hemisphere of the brain and emotion (holographic assistant).
When either or both of the hologram and the holographic assistant does not have the image of the participant, it or they may be created, for example, as a cartoon character. When both the hologram and the holographic assistant are in the form of a cartoon character, they may be the same or different.
The robot is preferably emotion-sensitive. In some embodiments, the robot is toy-like. In some embodiments, the robot is from about 50 cm to about 100 cm in height, for example from about 55 cm to about 90 cm.
The robot may be positioned in front of the participant. The position of the robot is movable and not fixed, but generally the position of the robot should not be such that the ability of the participant to observe fully the hologram and the holographic assistant is impaired.
The group of drones comprises more than one drone and up to about 10 drones, although a greater number of drones may also be employed in the interactive system of the present invention. In some embodiments, the group of drones comprises 5, 7, or 9 drones.
The group of drones may be positioned, for example, in front of the participant; at a height of, for example, about 2.1 m to about 2.2 m from the ground; and positioned at a distance of, for example, from about 2 m to about 3 m from the participant.
The group of drones is used to attract the attention of a participant, distract the participant, and/or deliver prizes and other items to the participant. Each drone may be operated synchronized in group or independently.
Interaction between the elements in the interactive system may comprise:
Which of the elements acts first in the methods of the present invention will depend on how the participant is seen to initially accept or choose the elements; thus, there is no fixed order for the action of the elements. The medical professional will direct which element starts in the method of the present invention, and how the method is continued, as described in more detail below.
The method of using the interactive system of the present invention for the treatment of ASD involves four steps:
These steps are described in more detail below.
This interactive system can be applied in individual training of a participant; in preparation for any therapies, activities, methods, etc.; and can be applied in preparation of the participant for work in group. This interactive system can be applied in individual training of humanoid robots for individual developments without programming.
The therapy space of the present invention is physically separated from a control area which from which parents, carers, medical specialists and computer operators can observe the therapy space.
As described in more detail below, two computer specialists operate the interactive system described herein, under the direction of a medical specialist.
The specific arrangement of the interactive elements in relation to the participant is designed to engage both hemispheres of the brain and the conscious and subconscious mind in the person with ASD.
The principles behind the interactive system and therapy space of the present invention and methods for their implementation and use are described in the following paragraphs, with particular reference to the needs and characteristics of a person with ASD.
Mode of Action and Interaction within the System Between the Different Elements
The interactive system of the present invention may be regarded as including two sections containing the interactive elements; a ‘primary’ part, and a ‘secondary’ part.
The primary part comprises the hologram and the holographic assistant. Each is independently operated, such that they may work together, show different emotions, perform different actions, say different words, and apply different reasoning. In a therapeutic setting, the role of the hologram and holographic assistant is to show opposite opinion, reactions and to demonstrate different emotions. Through the actions and communication of the hologram and the holographic assistant the conscious and the subconscious are given a practical experience. Through the multiple repetitions and simulations of the actions and the communication of the hologram and the holographic assistant, the participant is taught and memories are created and recorded in his or her conscious and subconscious. Thus, they are optimally independently managed by different people, i.e., by different computer operators positioned in the control area.
The secondary part includes the robot and the group of drones. These elements are connected to, and managed and synchronised by, the hologram and the holographic assistant or by the computer specialists.
The two parts can work together and separately and interact with each other.
All of the elements, in both sections, can work independently with the participant.
Thus, in the primary section, the hologram and the holographic assistant are commanded separately, but synchronised and there is interaction between the two elements: hologram-holographic assistant and holographic assistant-hologram.
Either or both of the elements of the secondary part, i.e., the robot and/or the group of drones, may supplement the work of the primary part.
For example, there may be interaction between the either or both elements of the primary part and the robot; namely: hologram-robot, holographic assistant-robot, hologram-holographic assistant-robot, and robot-hologram, robot-holographic assistant, robot-hologram-holographic assistant.
Alternatively, or in addition, interaction between the either or both elements of the core section and the group of drones, namely: hologram-group of drones and holographic assistant-group of drones or hologram-holographic assistant, hologram-robot, hologram-group of drones, holographic assistant-hologram, holographic assistant-robot, holographic assistant-group of drones, hologram-holographic assistant-robot, robot-hologram, robot-holographic assistant, robot-hologram-holographic assistant, robot-group of drones.
Method of Use of Interactive System for Treatment and Training for People with ASD and Training of Humanoid Robots
The method of using the interactive system of the present invention for the treatment and training of people with ASD and similar conditions and problems and the training of humanoid robots involves four steps:
The interactive system can be used without age restrictions.
Preparation of the Interactive System
The hologram and holographic assistant are created, for example, with full visual identity to the participant. The size of the hologram may for example be in a ratio of 1:1 with the participant, and the size of the holographic assistant proportionally reduced.
Most preferably, the hologram and the holographic assistant are each the created not only with physical identity of the participant, but also to imitate his or her characteristic movements, mimics (i.e., facial features and expressions), behaviour, characteristic sounds, word combinations, and other characteristics. The hologram and the holographic assistant are each programmed to synchronise with each other, with the robot, and with the group of drones. Parents, carers, and medical specialists may all contribute to the preparation of the interactive system.
Initial Preparation of the Participant and Functions of the Interactive Elements
In order to prepare the participant to use the interactive system of the present invention, the participant may be introduced into the therapy space, and on entry the participant sees all of the interactive elements. This will elicit a response from the participant, which will allow a medical specialist to make decisions, for example as to which interactive element will be preferred first in therapy. There is no fixed order, as the system of the present invention is designed to be personalised to each individual participant, and the starting element will be selected with the aim of relaxing the participant and encouraging him and her to sit within the therapy space.
The lack of physical presence of another person at the start will help the participant to relax and not to worry. In this way, the interactive system begins to do its job by bringing the participant unconsciously into a collective society. Once the participant is relaxed, the purpose is to start work with the hologram and the holographic assistant. Their different proportions, positioning and distance in relation to the participant will cause the participant to focus on each of the hologram and the holographic assistant separately, and in the full context of the therapy space.
Both brain hemispheres, and their live exchange of information, are imitated with the actions and communication of the hologram and the holographic assistant, associated also with consciousness and the subconscious. When communicating with the participant, the hologram and the holographic assistant behave in different ways, imitating both hemispheres of the brain.
An autistic person generally accepts everything literally. With the simultaneous action of the hologram and holographic assistant, he or she can be shown almost simultaneously two different variants and two different emotions. The actions of the conscious and the subconscious are shown in a given situation. Thus, the participant is given a choice, and in this way, may progress from passive mechanical repetition to becoming active. The availability of choice subtracts from a state of indifference in the participant, which state of indifference may reflect a neuronal deficiency. The actions and the communication of both the hologram and the holographic assistant may compensate for a compromised mechanism of mirror neurons in an autistic person. This helps for understanding the actions of other people.
The actions and communication of both the hologram and the holographic assistant a lively exchange of information between the two hemispheres of the brain, meaning the brain bridge is represented. The hologram and the holographic assistant normally display different opinions, feelings and states of mind (such a joy, happiness, sadness, etc.), they may behave differently and have different points of view. Dialogues between them reflect the inner dialogue that a person leads with him- or herself; for example, whether to do something or not; whether to buy something or not; whether to say something or not.
Through the actions and communication of the hologram and the holographic assistant, conscious and subconscious life experiences are given to the participant. The participant's thought and memories are created and recorded in his or her consciousness and subconscious. Thus, the hologram and the holographic assistant create the participant's faith in him- or herself and in his or her capabilities.
The hologram and the holographic assistant are programmed to work together, work alone, work sequentially, pause as if to think, concur or differ in emotion and opinion. When both holograms are interacting with each other and there is a lively exchange of information between them, but they cannot reach agreement on something, the robot may be employed. The robot represents an external opinion; an external decision; it will ask for explanations, as many times as necessary. When both holograms seek help from the robot, the participant should see that when he or she does not understand something or cannot do something on his or her own, he or she must seek out help. Help in this case is in the form of the robot. The participant may be involved and may participate in the choice to be made; however, if the participant does not participate, the holograms will make the choice with assistance from the robot.
Through repetition of the dialogue and actions between the hologram, the holographic assistant and the robot, the participant may be provoked to participate and make choices. For example, the robot may ask questions of the hologram and/or holographic assistant and try to involve the participant in the dialogue or help in decision making.
Thus, the robot will interact with each of the hologram and the holographic assistant individually until they reach a common solution. The robot creates the practice of repeating the action of the two holograms. It initiates the habit of repeating a certain situation, searching for opportunities, different options and solutions. It shows that there is no problem but different possibilities. Everything takes the form of play and entertainment, setting new goals and provoking desires. The purpose of the robot is to further affirm the belief of the participant in him- or herself and his or her capabilities.
The use of drones initially aims to attract the attention of the participant. With their appearance in a group, the drones interrupt and change the standard behaviour of the participant. He does not know how to react. In the process of interacting with the participant, the drones are used to provide support materials and reward to the participant. The reward is given for a repeated word, a given movement, a choice made for something the participant has done by himself. Awarding a reward is extremely important. It is reflected and remembered by the consciousness and the subconscious.
Use of the Interactive System in the Individual Training of Participants for Activities and Therapies
After a participant is acquainted with the interactive system and therapy space of the present invention, a personalised programme of activity may be introduced. In this, a hologram will demonstrate an exercise, action or activity for the participant to perform, such exercise, action or activity having been designed for the participant by a supervisor. By dividing the hologram into separate holograms, the participant can be shown the whole process in detail. In this way, accumulation of the required skills and knowledge is smooth and gradual. Once the exercise, action or activity has been explained in detail and the whole helping hologram shown. For example, the holograms may demonstrate a flower to the participant. First the complete flower is shown, then it is divided into details and each detail is shown and explained until it is accepted by the participant. Then the whole flower is shown again. The supervisor is then introduced and explains an activity or exercise to the participant—the supervisor is introduced so that the participant can get acquainted with, and accept, this person. When the participant is seen to understand in detail the given exercise, action or activity and is comfortable with the supervisor, he or she can participate in the given exercise, action or activity, learning, repeating many times, and remembering it. In this way, he or she is fully assured of his or her ability to perform independently the given activity or therapy.
Use of the Interactive System for Preparation of the Participant for Group Activities and Therapies
As a participant progresses with the interactive system of the present invention, he or she can move on from a single-participant therapy to one in which multiple participants are involved. Firstly, the participant will be presented with multiple holograms, for example, three, four, or more different holograms, each representing another user of the interactive system of the present invention. Thus, the participant may get acquainted with the idea of other participants, and observe them together, in a group. Once the participant is seen to be used to the multiple holograms, as well as knowing the supervisor and having performed independently and confidently in a given exercise, action or activity, he or she may be engaged in a real activity in a small group—firstly in a group that is familiar to him or her, and eventually, in a group in which none of the other participants is known to him or her. Thus, the interactive system of the present invention helps the participant to socialise and integrate.
Various embodiments of the invention are described in more detail below with reference to
With reference to
In some embodiments, in use, the hologram (2) is positioned on the left side of the participant (1), at a distanced from the participant, as illustrated in
The positioning of the hologram in front of the participant, ‘face-on’, may be seen in more detail in
The holographic assistant (3) is of smaller proportions than the participant (1) and the hologram (2), as illustrated in
As noted herein, the holographic assistant (3) may be a duplicate hologram having complete physical identity with the participant (1) and the hologram (2), but of different proportions. The holographic assistant (3) is deliberately made small, because it associates with the right hemisphere and the subconscious, and feelings and subconscious are not visible. Depending on the height of the participant, the holographic assistant may have a height (h) of 10 to 15 centimetres but is not limited thereto?
In some embodiments, in use, the holographic assistant (3) is positioned on the right side of the participant (1), at a distanced from the participant, as illustrated in
Connection 723 represents interaction between a hologram (2) and a holographic assistant (3), which interaction may include but is not limited to for example any of a monologue and action of each one of them, dialogue and action between the two, expressed in laughing, different sounds, speech, individual words, whole sentences, expressing the same opinion, expressing different opinions from one another, explaining, making different mimics, gestures, poses, showing and explaining of different emotional states, identical or different movements.
Connection 724 represents interaction between a hologram (2) and a robot (4), which interaction may include but is not limited to for example dialogue and action between the hologram and the robot, wherein the purpose is to obtain additional explanations and repetition by the hologram of an action, state or explanation. Connection 734 illustrates the interaction between a holographic assistant (3) and a robot (4), which interaction may include but is not limited to for example dialogue and action between the holographic assistant and the robot, wherein the purpose is to obtain additional explanations and repetitions by the holographic assistant of its different opinions, behaviours and actions of the hologram. Connection 725 represents an interaction between a hologram (2) and a group of drones (5) representing the control of the drones by the hologram, which interaction may include but is not limited to for example commands for giving helping materials and giving rewards to the participant. Connection 735 represents an interaction between a holographic assistant (3) and a group of drones (5) representing the control of the drones by the holographic assistant, which interaction may include but is not limited to for example commands for giving helping materials and giving rewards. Connection 745 represents an interaction between a robot (4) and a group of drones (5) representing the control of the drones by the robot, which interaction may include but is not limited to for example commands for giving helping materials and giving rewards. Connection 746 represents interaction between the robot (4) and the pair hologram (2) and the holographic assistant (3). In this connection, the hologram and the holographic assistant are accepted as a whole, that is, they act in a synchronized manner, come to a common opinion, to a common solution, and imitate common physical actions. The robot, talking to them, makes them repeat together the common decision or the common action. This interaction helps to repeat and confirm the commonly decided solution. Interactive system has interactions of three elements when more explanation, help, support and incentives are needed. The most commonly used three elements in combinations are a hologram (2), a holographic assistant (3) and a robot (4). The interaction may include but is not limited to for example monologues and actions of every one, and dialogue and action between the three. In this interaction, the differences between the hologram (2) and the holographic assistant (3) are clearly visible, as two different sides of a problem; two different ways behaviour. The robot focuses on differences, presents the problem as an opportunity, and offers new options for overcoming a given situation.
Different situations trough simulation that are being played show that there is always a way out and a solution to a problem, and the problem is presented as an opportunity. The other three elements that interact together, respectively, are a hologram (2), a holographic assistant (3) and a group of drones (5); a hologram (2), a robot (4) and a group of drones (5); and a holographic assistant (3), a robot (4) and a group of drones (5). In these triples the purpose is to use the group of drones (5) respectively by the hologram, holographic assistant or robot. The use of the group of drones (5) by one of the elements of the interactive system depends on the current situation, the needs of the participant and which of the three is the most appropriate one to command the group of drones in a situation. All elements of the interactive system—hologram (2), holographic assistant (3), group of drones (5) and robot (4) participate in the interaction of the quadruple. They are used together when completing an action or activity.
The advantages of the interactive system are the lack of a person, the type of self-learning and the heterogeneity of the group—a large hologram, a small hologram, a group of drones and a robot.
This interactive system can train participants, users and humanoid robots. In connection with brain modeling of humanoid robots, the application of the interactive system will lead to better results in communicating with people.
Interactions are not limited to the sequences described above. The performance of interactions is determined depending on the condition and needs of the participant.
Interactions are not limited to the sequences described above. The performance of interactions is determined depending on the condition and needs of the participant.
Interactions are not limited to the sequences described above. The performance of interactions is determined depending on the condition and needs of the participant.
Interactions are not limited to the sequences described above. The performance of interactions is determined depending on the condition and needs of the participant.
Therapies that can be delivered by the present method and interactive system include, but are not limited to, Music therapy, Biofeedback, Drum therapy, Ergo therapy, Hydro therapy, Art therapy, Hippo therapy, Kanis therapy, Feline therapy, Hyperbaric Oxygen therapy, Honey therapy, Sand therapy, Aromatherapy, and activities in gardening, cooking, pastry.
The invention is further characterised with reference to the following claims.
Murdjeva, Yuliana Ivanova, Murdjeva, Nicoletta Atanasova
| Patent | Priority | Assignee | Title |
| Patent | Priority | Assignee | Title |
| 9808709, | Sep 27 2013 | PlayNovation LLC | System and methods for biometric detection of play states, intrinsic motivators, play types/patterns and play personalities |
| 20120194420, | |||
| 20140184496, | |||
| 20160082319, | |||
| 20170319123, | |||
| 20170365277, | |||
| 20180015347, | |||
| 20180188850, | |||
| 20180308473, | |||
| 20190188788, | |||
| 20190270026, | |||
| 20210387346, | |||
| EP3312824, | |||
| WO2018033857, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| Date | Maintenance Fee Events |
| Oct 18 2021 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
| Nov 03 2021 | MICR: Entity status set to Micro. |
| Date | Maintenance Schedule |
| Oct 03 2026 | 4 years fee payment window open |
| Apr 03 2027 | 6 months grace period start (w surcharge) |
| Oct 03 2027 | patent expiry (for year 4) |
| Oct 03 2029 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Oct 03 2030 | 8 years fee payment window open |
| Apr 03 2031 | 6 months grace period start (w surcharge) |
| Oct 03 2031 | patent expiry (for year 8) |
| Oct 03 2033 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Oct 03 2034 | 12 years fee payment window open |
| Apr 03 2035 | 6 months grace period start (w surcharge) |
| Oct 03 2035 | patent expiry (for year 12) |
| Oct 03 2037 | 2 years to revive unintentionally abandoned end. (for year 12) |