METHOD AND APPARATUS FOR GENERATING VEHICLE DAMAGE IMAGE ON THE BASIS OF GAN NETWORK | Matter42 Literature
Patent
Atlas literature
Patent
US 11,972,599 B2
METHOD AND APPARATUS FOR GENERATING VEHICLE DAMAGE IMAGE ON THE BASIS OF GAN NETWORK
Juan Xu
Advanced New Technologies Co., Ltd., George Town (KY)·Apr. 30, 2024·US
Drawings
Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1
FIG. 1 illustrates a schematic diagram of a vehicle dam- age image generation system 100 according to an embodi- ment of the present specification;
FIG. 2
FIG. 2 illustrates a flowchart of a method for training a discriminative model for vehicle damage images according to an embodiment of the present specification;
FIG. 3
FIG. 3 illustrates a flowchart of a method for training an image filling model according to an embodiment of the present specification;
FIG. 4
FIG. 4 illustrates a flowchart of a computer-executed method for generating a vehicle damage image according to an embodiment of the present specification;
FIG. 5
FIG. 5 illustrates an apparatus 500 for training a discrimi- native model for vehicle damage images according to an embodiment of the present specification;
FIG. 6
FIG. 6 illustrates an apparatus 600 for training an image filling model according to an embodiment of the present specification; and
FIG. 7
FIG. 7 illustrates a computer-executed apparatus 700 for generating a vehicle damage image according to an embodi- ment of the present specification.
FIG. 8
FIG. 8 illustrates an exemplary computer and communi- cation system for generating vehicle damage images accord- ing to one embodiment of the present …
FIG. 9
FIG. 9 illustrates an exemplary network environment for implementing the disclosed technology, in accordance with some embodiments described herein.
Claims
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
4 independent · 17 dependent
1
Independent
A computer-executed method for generating a vehicle damage image, comprising: obtaining a real vehicle image; generating, by a computer, an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and generating the vehicle damage image based on the intermediate image by inputting the intermediate image into a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein the real vehicle image includes one or more local images indicating vehicle damage, and wherein label-ing the target box comprises randomly selecting a labeling location corresponding to one of the one or more local images indicating vehicle damage.
2
Dependent← claim 1
The method of claim 1, wherein labeling the target box comprises: determining, based on statistics, a plurality of locations at which vehicle damage occurs with a high probability; and randomly selecting, from the plurality of locations, a location for labeling the target box.
3
Dependent← claim 1
The method of claim 1, wherein removing a portion of the real vehicle image comprises applying a mask, which comprises performing a dot-product operation on the real vehicle image and the mask.
4
Dependent← claim 1
The method of claim 1, wherein the machine-learning model is a generative model in a Generative Adversarial Network (GAN) model, wherein the GAN model further comprises a discriminative model for determining whether an output image of the generative model is a real image and whether a local image indicating vehicle damage is in the target box of the output image, and wherein the generative model is trained based on the discriminative model, a second real vehicle image, and a second intermediate image gen-erated based on the second real vehicle image.
9
Dependent← claim 1
The method of claim 1, further comprising: using the generated vehicle damage image to train a vehicle damage identification model for identifying damage to a vehicle based on a vehicle damage image.
10
Independent
A computer-executed apparatus for generating a vehicle damage image, comprising: an image-acquisition unit configured to acquire a real vehicle image; an intermediate-image generation unit configured to gen-erate an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and a vehicle-damage-image generation unit configured to generate the vehicle damage image based on the intermediate image by inputting the intermediate image into a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein the machine-learning model is a generative model in a Generative Adversarial Network (GAN) model, wherein the GAN model further comprises a discriminative model for determining whether an out-put image of the generative model is a real image and whether a local image indicating vehicle damage is in the target box of the output image, and wherein the generative model is trained based on the discriminative model, a second real vehicle image, and a second intermediate image generated based on the second real vehicle image.
11
Dependent← claim 10
The apparatus of claim 10, wherein the real vehicle image comprises one or more local images indicating vehicle damage, and wherein, while labeling the target box, the intermediate-image generation unit is configured to randomly select a labeling location corresponding to one of the one or more local images indicating vehicle damage.
12
Dependent← claim 10
The apparatus of claim 10, wherein, while labeling the target box, the intermediate-image generation unit is con-figured to: determine, based on statistics, a plurality of locations at which vehicle damage occurs with a high probability; and randomly select, from the plurality of locations, a location for labeling the target box.
13
Dependent← claim 10
The apparatus of claim 10, wherein, while removing a portion of the real vehicle image, the intermediate-image generation unit is configured to apply a mask on the real vehicle image, which comprises performing a dot-product operation on the real vehicle image and the mask.
14
Dependent← claim 10
The apparatus of claim 10, further comprising a model training unit configured to: obtain a plurality of positive samples and a plurality of negative samples, wherein a respective positive sample is a real image comprising a labeled target box, wherein the target box of the positive sample comprises a local image indicating vehicle damage, wherein the plurality of negative samples comprises a first negative sample being a non-real image comprising a labeled target box, and wherein the first negative sample is obtained by replacing the local image within the target box of a real image with another local image; and use the plurality of positive samples and the plurality of negative samples to train a classification model to be used as the discriminative model.
18
Dependent← claim 10
The apparatus of claim 10, further comprising a 20 second model training unit configured to use the generated vehicle damage image to train a vehicle damage identifica-tion model for identifying damage to a vehicle based on a vehicle damage image.
19
Independent
A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for generating a vehicle damage image, the method comprising: obtaining a real vehicle image; generating an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and generating the vehicle damage image based on the intermediate image by inputting the intermediate image into B₂ a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein labeling the target box includes: determining, based on statistics, a plurality of locations at which vehicle damage occurs with a high prob-ability; and randomly selecting, from the plurality of locations, a location for labeling the target box.
20
Dependent← claim 19
The non-transitory computer-readable storage medium according to claim 19, wherein the real vehicle image comprises one or more local images indicating vehicle damage, and wherein labeling the target box includes randomly selecting a labeling location correspond-ing to one of the one or more local images indicating vehicle damage.
21
Independent
A computer-executed method for generating a vehicle damage image, comprising: obtaining a real vehicle image; generating, by a computer, an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and generating the vehicle damage image based on the intermediate image by inputting the intermediate image into a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein removing a portion of the real vehicle image includes applying a mask, which includes performing a dot-product operation on the real vehicle image and the mask. ∗ ∗ ∗ ∗ ∗
Cited prior art
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 87
US 6,397,334 B16,397,334 B1 5/2002 Chainer
US 7,093,129 B17,093,129 B1 8/2006 Gavagni
US 7,401,012 B17,401,012 B1 7/2008 Bonebakker
US 7,872,584 B27,872,584 B2 1/2011 Chen
US 8,180,629 B28,180,629 B2 5/2012 Rehberg
US 8,448,226 B28,448,226 B2 5/2013 Narasimhan
US 8,966,613 B28,966,613 B2 2/2015 Horvitz
Patent
Atlas literature
Patent
US 11,972,599 B2
METHOD AND APPARATUS FOR GENERATING VEHICLE DAMAGE IMAGE ON THE BASIS OF GAN NETWORK
Juan Xu
Advanced New Technologies Co., Ltd., George Town (KY)·Apr. 30, 2024·US
Drawings
Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1
FIG. 1 illustrates a schematic diagram of a vehicle dam- age image generation system 100 according to an embodi- ment of the present specification;
FIG. 2
FIG. 2 illustrates a flowchart of a method for training a discriminative model for vehicle damage images according to an embodiment of the present specification;
FIG. 3
FIG. 3 illustrates a flowchart of a method for training an image filling model according to an embodiment of the present specification;
FIG. 4
FIG. 4 illustrates a flowchart of a computer-executed method for generating a vehicle damage image according to an embodiment of the present specification;
FIG. 5
FIG. 5 illustrates an apparatus 500 for training a discrimi- native model for vehicle damage images according to an embodiment of the present specification;
FIG. 6
FIG. 6 illustrates an apparatus 600 for training an image filling model according to an embodiment of the present specification; and
FIG. 7
FIG. 7 illustrates a computer-executed apparatus 700 for generating a vehicle damage image according to an embodi- ment of the present specification.
FIG. 8
FIG. 8 illustrates an exemplary computer and communi- cation system for generating vehicle damage images accord- ing to one embodiment of the present …
FIG. 9
FIG. 9 illustrates an exemplary network environment for implementing the disclosed technology, in accordance with some embodiments described herein.
Claims
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
4 independent · 17 dependent
1
Independent
A computer-executed method for generating a vehicle damage image, comprising: obtaining a real vehicle image; generating, by a computer, an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and generating the vehicle damage image based on the intermediate image by inputting the intermediate image into a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein the real vehicle image includes one or more local images indicating vehicle damage, and wherein label-ing the target box comprises randomly selecting a labeling location corresponding to one of the one or more local images indicating vehicle damage.
2
Dependent← claim 1
The method of claim 1, wherein labeling the target box comprises: determining, based on statistics, a plurality of locations at which vehicle damage occurs with a high probability; and randomly selecting, from the plurality of locations, a location for labeling the target box.
3
Dependent← claim 1
The method of claim 1, wherein removing a portion of the real vehicle image comprises applying a mask, which comprises performing a dot-product operation on the real vehicle image and the mask.
4
Dependent← claim 1
The method of claim 1, wherein the machine-learning model is a generative model in a Generative Adversarial Network (GAN) model, wherein the GAN model further comprises a discriminative model for determining whether an output image of the generative model is a real image and whether a local image indicating vehicle damage is in the target box of the output image, and wherein the generative model is trained based on the discriminative model, a second real vehicle image, and a second intermediate image gen-erated based on the second real vehicle image.
9
Dependent← claim 1
The method of claim 1, further comprising: using the generated vehicle damage image to train a vehicle damage identification model for identifying damage to a vehicle based on a vehicle damage image.
10
Independent
A computer-executed apparatus for generating a vehicle damage image, comprising: an image-acquisition unit configured to acquire a real vehicle image; an intermediate-image generation unit configured to gen-erate an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and a vehicle-damage-image generation unit configured to generate the vehicle damage image based on the intermediate image by inputting the intermediate image into a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein the machine-learning model is a generative model in a Generative Adversarial Network (GAN) model, wherein the GAN model further comprises a discriminative model for determining whether an out-put image of the generative model is a real image and whether a local image indicating vehicle damage is in the target box of the output image, and wherein the generative model is trained based on the discriminative model, a second real vehicle image, and a second intermediate image generated based on the second real vehicle image.
11
Dependent← claim 10
The apparatus of claim 10, wherein the real vehicle image comprises one or more local images indicating vehicle damage, and wherein, while labeling the target box, the intermediate-image generation unit is configured to randomly select a labeling location corresponding to one of the one or more local images indicating vehicle damage.
12
Dependent← claim 10
The apparatus of claim 10, wherein, while labeling the target box, the intermediate-image generation unit is con-figured to: determine, based on statistics, a plurality of locations at which vehicle damage occurs with a high probability; and randomly select, from the plurality of locations, a location for labeling the target box.
13
Dependent← claim 10
The apparatus of claim 10, wherein, while removing a portion of the real vehicle image, the intermediate-image generation unit is configured to apply a mask on the real vehicle image, which comprises performing a dot-product operation on the real vehicle image and the mask.
14
Dependent← claim 10
The apparatus of claim 10, further comprising a model training unit configured to: obtain a plurality of positive samples and a plurality of negative samples, wherein a respective positive sample is a real image comprising a labeled target box, wherein the target box of the positive sample comprises a local image indicating vehicle damage, wherein the plurality of negative samples comprises a first negative sample being a non-real image comprising a labeled target box, and wherein the first negative sample is obtained by replacing the local image within the target box of a real image with another local image; and use the plurality of positive samples and the plurality of negative samples to train a classification model to be used as the discriminative model.
18
Dependent← claim 10
The apparatus of claim 10, further comprising a 20 second model training unit configured to use the generated vehicle damage image to train a vehicle damage identifica-tion model for identifying damage to a vehicle based on a vehicle damage image.
19
Independent
A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for generating a vehicle damage image, the method comprising: obtaining a real vehicle image; generating an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and generating the vehicle damage image based on the intermediate image by inputting the intermediate image into B₂ a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein labeling the target box includes: determining, based on statistics, a plurality of locations at which vehicle damage occurs with a high prob-ability; and randomly selecting, from the plurality of locations, a location for labeling the target box.
20
Dependent← claim 19
The non-transitory computer-readable storage medium according to claim 19, wherein the real vehicle image comprises one or more local images indicating vehicle damage, and wherein labeling the target box includes randomly selecting a labeling location correspond-ing to one of the one or more local images indicating vehicle damage.
21
Independent
A computer-executed method for generating a vehicle damage image, comprising: obtaining a real vehicle image; generating, by a computer, an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and generating the vehicle damage image based on the intermediate image by inputting the intermediate image into a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein removing a portion of the real vehicle image includes applying a mask, which includes performing a dot-product operation on the real vehicle image and the mask. ∗ ∗ ∗ ∗ ∗
Cited prior art
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 87
US 6,397,334 B16,397,334 B1 5/2002 Chainer
US 7,093,129 B17,093,129 B1 8/2006 Gavagni
US 7,401,012 B17,401,012 B1 7/2008 Bonebakker
US 7,872,584 B27,872,584 B2 1/2011 Chen
US 8,180,629 B28,180,629 B2 5/2012 Rehberg
US 8,448,226 B28,448,226 B2 5/2013 Narasimhan
US 8,966,613 B28,966,613 B2 2/2015 Horvitz
Patent
Atlas literature
Patent
US 11,972,599 B2
METHOD AND APPARATUS FOR GENERATING VEHICLE DAMAGE IMAGE ON THE BASIS OF GAN NETWORK
Juan Xu
Advanced New Technologies Co., Ltd., George Town (KY)·Apr. 30, 2024·US
Drawings
Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1
FIG. 1 illustrates a schematic diagram of a vehicle dam- age image generation system 100 according to an embodi- ment of the present specification;
FIG. 2
FIG. 2 illustrates a flowchart of a method for training a discriminative model for vehicle damage images according to an embodiment of the present specification;
FIG. 3
FIG. 3 illustrates a flowchart of a method for training an image filling model according to an embodiment of the present specification;
FIG. 4
FIG. 4 illustrates a flowchart of a computer-executed method for generating a vehicle damage image according to an embodiment of the present specification;
FIG. 5
FIG. 5 illustrates an apparatus 500 for training a discrimi- native model for vehicle damage images according to an embodiment of the present specification;
FIG. 6
FIG. 6 illustrates an apparatus 600 for training an image filling model according to an embodiment of the present specification; and
FIG. 7
FIG. 7 illustrates a computer-executed apparatus 700 for generating a vehicle damage image according to an embodi- ment of the present specification.
FIG. 8
FIG. 8 illustrates an exemplary computer and communi- cation system for generating vehicle damage images accord- ing to one embodiment of the present …
FIG. 9
FIG. 9 illustrates an exemplary network environment for implementing the disclosed technology, in accordance with some embodiments described herein.
Claims
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
4 independent · 17 dependent
1
Independent
A computer-executed method for generating a vehicle damage image, comprising: obtaining a real vehicle image; generating, by a computer, an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and generating the vehicle damage image based on the intermediate image by inputting the intermediate image into a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein the real vehicle image includes one or more local images indicating vehicle damage, and wherein label-ing the target box comprises randomly selecting a labeling location corresponding to one of the one or more local images indicating vehicle damage.
2
Dependent← claim 1
The method of claim 1, wherein labeling the target box comprises: determining, based on statistics, a plurality of locations at which vehicle damage occurs with a high probability; and randomly selecting, from the plurality of locations, a location for labeling the target box.
3
Dependent← claim 1
The method of claim 1, wherein removing a portion of the real vehicle image comprises applying a mask, which comprises performing a dot-product operation on the real vehicle image and the mask.
4
Dependent← claim 1
The method of claim 1, wherein the machine-learning model is a generative model in a Generative Adversarial Network (GAN) model, wherein the GAN model further comprises a discriminative model for determining whether an output image of the generative model is a real image and whether a local image indicating vehicle damage is in the target box of the output image, and wherein the generative model is trained based on the discriminative model, a second real vehicle image, and a second intermediate image gen-erated based on the second real vehicle image.
9
Dependent← claim 1
The method of claim 1, further comprising: using the generated vehicle damage image to train a vehicle damage identification model for identifying damage to a vehicle based on a vehicle damage image.
10
Independent
A computer-executed apparatus for generating a vehicle damage image, comprising: an image-acquisition unit configured to acquire a real vehicle image; an intermediate-image generation unit configured to gen-erate an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and a vehicle-damage-image generation unit configured to generate the vehicle damage image based on the intermediate image by inputting the intermediate image into a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein the machine-learning model is a generative model in a Generative Adversarial Network (GAN) model, wherein the GAN model further comprises a discriminative model for determining whether an out-put image of the generative model is a real image and whether a local image indicating vehicle damage is in the target box of the output image, and wherein the generative model is trained based on the discriminative model, a second real vehicle image, and a second intermediate image generated based on the second real vehicle image.
11
Dependent← claim 10
The apparatus of claim 10, wherein the real vehicle image comprises one or more local images indicating vehicle damage, and wherein, while labeling the target box, the intermediate-image generation unit is configured to randomly select a labeling location corresponding to one of the one or more local images indicating vehicle damage.
12
Dependent← claim 10
The apparatus of claim 10, wherein, while labeling the target box, the intermediate-image generation unit is con-figured to: determine, based on statistics, a plurality of locations at which vehicle damage occurs with a high probability; and randomly select, from the plurality of locations, a location for labeling the target box.
13
Dependent← claim 10
The apparatus of claim 10, wherein, while removing a portion of the real vehicle image, the intermediate-image generation unit is configured to apply a mask on the real vehicle image, which comprises performing a dot-product operation on the real vehicle image and the mask.
14
Dependent← claim 10
The apparatus of claim 10, further comprising a model training unit configured to: obtain a plurality of positive samples and a plurality of negative samples, wherein a respective positive sample is a real image comprising a labeled target box, wherein the target box of the positive sample comprises a local image indicating vehicle damage, wherein the plurality of negative samples comprises a first negative sample being a non-real image comprising a labeled target box, and wherein the first negative sample is obtained by replacing the local image within the target box of a real image with another local image; and use the plurality of positive samples and the plurality of negative samples to train a classification model to be used as the discriminative model.
18
Dependent← claim 10
The apparatus of claim 10, further comprising a 20 second model training unit configured to use the generated vehicle damage image to train a vehicle damage identifica-tion model for identifying damage to a vehicle based on a vehicle damage image.
19
Independent
A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for generating a vehicle damage image, the method comprising: obtaining a real vehicle image; generating an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and generating the vehicle damage image based on the intermediate image by inputting the intermediate image into B₂ a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein labeling the target box includes: determining, based on statistics, a plurality of locations at which vehicle damage occurs with a high prob-ability; and randomly selecting, from the plurality of locations, a location for labeling the target box.
20
Dependent← claim 19
The non-transitory computer-readable storage medium according to claim 19, wherein the real vehicle image comprises one or more local images indicating vehicle damage, and wherein labeling the target box includes randomly selecting a labeling location correspond-ing to one of the one or more local images indicating vehicle damage.
21
Independent
A computer-executed method for generating a vehicle damage image, comprising: obtaining a real vehicle image; generating, by a computer, an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and generating the vehicle damage image based on the intermediate image by inputting the intermediate image into a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein removing a portion of the real vehicle image includes applying a mask, which includes performing a dot-product operation on the real vehicle image and the mask. ∗ ∗ ∗ ∗ ∗
Cited prior art
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 87
US 6,397,334 B16,397,334 B1 5/2002 Chainer
US 7,093,129 B17,093,129 B1 8/2006 Gavagni
US 7,401,012 B17,401,012 B1 7/2008 Bonebakker
US 7,872,584 B27,872,584 B2 1/2011 Chen
US 8,180,629 B28,180,629 B2 5/2012 Rehberg
US 8,448,226 B28,448,226 B2 5/2013 Narasimhan
US 8,966,613 B28,966,613 B2 2/2015 Horvitz
Patent
Atlas literature
Patent
US 11,972,599 B2
METHOD AND APPARATUS FOR GENERATING VEHICLE DAMAGE IMAGE ON THE BASIS OF GAN NETWORK
Juan Xu
Advanced New Technologies Co., Ltd., George Town (KY)·Apr. 30, 2024·US
Drawings
Patent drawings and their descriptions. Click a drawing to enlarge it.
FIG. 1
FIG. 1 illustrates a schematic diagram of a vehicle dam- age image generation system 100 according to an embodi- ment of the present specification;
FIG. 2
FIG. 2 illustrates a flowchart of a method for training a discriminative model for vehicle damage images according to an embodiment of the present specification;
FIG. 3
FIG. 3 illustrates a flowchart of a method for training an image filling model according to an embodiment of the present specification;
FIG. 4
FIG. 4 illustrates a flowchart of a computer-executed method for generating a vehicle damage image according to an embodiment of the present specification;
FIG. 5
FIG. 5 illustrates an apparatus 500 for training a discrimi- native model for vehicle damage images according to an embodiment of the present specification;
FIG. 6
FIG. 6 illustrates an apparatus 600 for training an image filling model according to an embodiment of the present specification; and
FIG. 7
FIG. 7 illustrates a computer-executed apparatus 700 for generating a vehicle damage image according to an embodi- ment of the present specification.
FIG. 8
FIG. 8 illustrates an exemplary computer and communi- cation system for generating vehicle damage images accord- ing to one embodiment of the present …
FIG. 9
FIG. 9 illustrates an exemplary network environment for implementing the disclosed technology, in accordance with some embodiments described herein.
Claims
Claims define the patent's legal scope. Independent claims stand alone; dependent claims (nested) narrow them. Click a claim to expand its dependents.
4 independent · 17 dependent
1
Independent
A computer-executed method for generating a vehicle damage image, comprising: obtaining a real vehicle image; generating, by a computer, an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and generating the vehicle damage image based on the intermediate image by inputting the intermediate image into a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein the real vehicle image includes one or more local images indicating vehicle damage, and wherein label-ing the target box comprises randomly selecting a labeling location corresponding to one of the one or more local images indicating vehicle damage.
2
Dependent← claim 1
The method of claim 1, wherein labeling the target box comprises: determining, based on statistics, a plurality of locations at which vehicle damage occurs with a high probability; and randomly selecting, from the plurality of locations, a location for labeling the target box.
3
Dependent← claim 1
The method of claim 1, wherein removing a portion of the real vehicle image comprises applying a mask, which comprises performing a dot-product operation on the real vehicle image and the mask.
4
Dependent← claim 1
The method of claim 1, wherein the machine-learning model is a generative model in a Generative Adversarial Network (GAN) model, wherein the GAN model further comprises a discriminative model for determining whether an output image of the generative model is a real image and whether a local image indicating vehicle damage is in the target box of the output image, and wherein the generative model is trained based on the discriminative model, a second real vehicle image, and a second intermediate image gen-erated based on the second real vehicle image.
9
Dependent← claim 1
The method of claim 1, further comprising: using the generated vehicle damage image to train a vehicle damage identification model for identifying damage to a vehicle based on a vehicle damage image.
10
Independent
A computer-executed apparatus for generating a vehicle damage image, comprising: an image-acquisition unit configured to acquire a real vehicle image; an intermediate-image generation unit configured to gen-erate an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and a vehicle-damage-image generation unit configured to generate the vehicle damage image based on the intermediate image by inputting the intermediate image into a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein the machine-learning model is a generative model in a Generative Adversarial Network (GAN) model, wherein the GAN model further comprises a discriminative model for determining whether an out-put image of the generative model is a real image and whether a local image indicating vehicle damage is in the target box of the output image, and wherein the generative model is trained based on the discriminative model, a second real vehicle image, and a second intermediate image generated based on the second real vehicle image.
11
Dependent← claim 10
The apparatus of claim 10, wherein the real vehicle image comprises one or more local images indicating vehicle damage, and wherein, while labeling the target box, the intermediate-image generation unit is configured to randomly select a labeling location corresponding to one of the one or more local images indicating vehicle damage.
12
Dependent← claim 10
The apparatus of claim 10, wherein, while labeling the target box, the intermediate-image generation unit is con-figured to: determine, based on statistics, a plurality of locations at which vehicle damage occurs with a high probability; and randomly select, from the plurality of locations, a location for labeling the target box.
13
Dependent← claim 10
The apparatus of claim 10, wherein, while removing a portion of the real vehicle image, the intermediate-image generation unit is configured to apply a mask on the real vehicle image, which comprises performing a dot-product operation on the real vehicle image and the mask.
14
Dependent← claim 10
The apparatus of claim 10, further comprising a model training unit configured to: obtain a plurality of positive samples and a plurality of negative samples, wherein a respective positive sample is a real image comprising a labeled target box, wherein the target box of the positive sample comprises a local image indicating vehicle damage, wherein the plurality of negative samples comprises a first negative sample being a non-real image comprising a labeled target box, and wherein the first negative sample is obtained by replacing the local image within the target box of a real image with another local image; and use the plurality of positive samples and the plurality of negative samples to train a classification model to be used as the discriminative model.
18
Dependent← claim 10
The apparatus of claim 10, further comprising a 20 second model training unit configured to use the generated vehicle damage image to train a vehicle damage identifica-tion model for identifying damage to a vehicle based on a vehicle damage image.
19
Independent
A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for generating a vehicle damage image, the method comprising: obtaining a real vehicle image; generating an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and generating the vehicle damage image based on the intermediate image by inputting the intermediate image into B₂ a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein labeling the target box includes: determining, based on statistics, a plurality of locations at which vehicle damage occurs with a high prob-ability; and randomly selecting, from the plurality of locations, a location for labeling the target box.
20
Dependent← claim 19
The non-transitory computer-readable storage medium according to claim 19, wherein the real vehicle image comprises one or more local images indicating vehicle damage, and wherein labeling the target box includes randomly selecting a labeling location correspond-ing to one of the one or more local images indicating vehicle damage.
21
Independent
A computer-executed method for generating a vehicle damage image, comprising: obtaining a real vehicle image; generating, by a computer, an intermediate image based on the real vehicle image by labeling a target box on the real vehicle image and removing a portion of the real vehicle image within the target box; and generating the vehicle damage image based on the intermediate image by inputting the intermediate image into a machine-learning model, which outputs the vehicle damage image by filling a local image indicating vehicle damage into the target box of the intermediate image, wherein removing a portion of the real vehicle image includes applying a mask, which includes performing a dot-product operation on the real vehicle image and the mask. ∗ ∗ ∗ ∗ ∗
Cited prior art
Patents and literature cited by this patent (applicant and examiner references).
Cited patents · 87
US 6,397,334 B16,397,334 B1 5/2002 Chainer
US 7,093,129 B17,093,129 B1 8/2006 Gavagni
US 7,401,012 B17,401,012 B1 7/2008 Bonebakker
US 7,872,584 B27,872,584 B2 1/2011 Chen
US 8,180,629 B28,180,629 B2 5/2012 Rehberg
US 8,448,226 B28,448,226 B2 5/2013 Narasimhan
US 8,966,613 B28,966,613 B2 2/2015 Horvitz
89
US 9,036,943 B19,036,943 B1 5/2015 Baldwin
US 9,582,843 B29,582,843 B2 2/2017 Leonard
US 9,607,138 B19,607,138 B1 3/2017 Baldwin
US 10,445,638 B110,445,638 B1 * 10/2019 Amirineni............... G06F 17/11examiner
US 10,475,014 B110,475,014 B1 11/2019 Ramalingam
US 10,554,738 B110,554,738 B1 2/2020 Ren
US 10,699,168 B110,699,168 B1 * 6/2020 Xu......................... G06Q 10/00examiner
US 10,846,716 B110,846,716 B1 * 11/2020 Chow................... G06T 7/0002examiner
US 11,138,292 B111,138,292 B1 * 10/2021 Nair....................... G06N 3/063examiner
US 2001/0046659 A12001/0046659 A1 11/2001 Oster
US 2002/0136459 A12002/0136459 A1 9/2002 Imagawa
US 2003/0229789 A12003/0229789 A1 12/2003 Morais
US 2004/0167765 A12004/0167765 A1 8/2004 Abu El Ata
US 2004/0196363 A12004/0196363 A1 10/2004 Diamond
US 2005/0232424 A12005/0232424 A1 10/2005 Dobranski
US 2009/0087025 A12009/0087025 A1 4/2009 Ma
US 2009/0206993 A12009/0206993 A1 8/2009 Di Mambro
US 2010/0128923 A12010/0128923 A1 5/2010 Kiya
US 2010/0135490 A12010/0135490 A1 6/2010 Kwon
US 2011/0069892 A12011/0069892 A1 3/2011 Tsai
US 2011/0162679 A12011/0162679 A1 7/2011 Demmeler
US 2012/0269346 A12012/0269346 A1 10/2012 Best
US 2013/0015946 A12013/0015946 A1 1/2013 Lau
US 2013/0182002 A12013/0182002 A1 7/2013 Macciola
US 2013/0208103 A12013/0208103 A1 8/2013 Sands
US 2013/0208956 A12013/0208956 A1 * 8/2013 Wehnes............... G06V 10/454examiner
US 2014/0037184 A12014/0037184 A1 2/2014 Gorski
US 2014/0270411 A12014/0270411 A1 9/2014 Shu
US 2014/0309805 A12014/0309805 A1 10/2014 Ricci
US 2014/0313334 A12014/0313334 A1 10/2014 Slotky
US 2015/0036891 A12015/0036891 A1 2/2015 Takenouchi
US 2015/0103170 A12015/0103170 A1 4/2015 Nelson
US 2015/0110364 A12015/0110364 A1 4/2015 Niinuma
US 2015/0110366 A12015/0110366 A1 4/2015 Sezille
US 2015/0341370 A12015/0341370 A1 11/2015 Khan
US 2016/0034786 A12016/0034786 A1 2/2016 Suri
US 2016/0044030 A12016/0044030 A1 2/2016 Galwas
US 2016/0063235 A12016/0063235 A1 3/2016 Tussy
US 2016/0283787 A12016/0283787 A1 9/2016 Nepomniachtchi
US 2016/0307029 A12016/0307029 A1 10/2016 Vaknin
US 2017/0048244 A12017/0048244 A1 2/2017 Loughlin-Mchugh
US 2017/0060867 A12017/0060867 A1 3/2017 Moutinho
US 2017/0061563 A12017/0061563 A1 3/2017 Falkenstern
US 2017/0148102 A12017/0148102 A1 5/2017 Franke
US 2017/0221110 A12017/0221110 A1 * 8/2017 Sullivan................. G06Q 10/20examiner
US 2017/0293894 A12017/0293894 A1 10/2017 Taliwal
US 2018/0047208 A12018/0047208 A1 2/2018 Marin
US 2018/0083973 A12018/0083973 A1 3/2018 Paraskevas
US 2018/0182039 A12018/0182039 A1 6/2018 Wang
US 2018/0247112 A12018/0247112 A1 8/2018 Norimatsu
US 2018/0260793 A12018/0260793 A1 * 9/2018 Li.......................... G06Q 40/08examiner
US 2018/0293552 A12018/0293552 A1 * 10/2018 Zhang.............. G06Q 10/06395examiner
US 2018/0293664 A12018/0293664 A1 * 10/2018 Zhang.................. G06V 10/454examiner
US 2018/0293806 A12018/0293806 A1 * 10/2018 Zhang...................... G06N 3/08examiner
US 2018/0300576 A12018/0300576 A1 10/2018 Dalyac
US 2019/0035112 A12019/0035112 A1 1/2019 Lee
US 2019/0073641 A12019/0073641 A1 3/2019 Utke
US 2019/0095877 A12019/0095877 A1 * 3/2019 Li.......................... G06V 20/63examiner
US 2019/0156178 A12019/0156178 A1 5/2019 Thornton
US 2019/0266015 A12019/0266015 A1 8/2019 Chandra
US 2019/0294878 A12019/0294878 A1 9/2019 Endras
US 2019/0355366 A12019/0355366 A1 11/2019 Ng
US 2020/0005151 A12020/0005151 A1 1/2020 Jiang
US 2020/0034958 A12020/0034958 A1 1/2020 Campbell
US 2020/0050867 A12020/0050867 A1 * 2/2020 Zhang.................... G06V 20/41examiner
US 2020/0050939 A12020/0050939 A1 2/2020 Zhu
US 2020/0051237 A12020/0051237 A1 2/2020 Spivey
US 2020/0065632 A12020/0065632 A1 * 2/2020 Guo....................... H04N 23/64examiner
US 2020/0074222 A12020/0074222 A1 * 3/2020 Guo......................... G06N 3/08examiner
US 2020/0074560 A12020/0074560 A1 * 3/2020 Xu........................... G06N 3/08examiner
US 2020/0125885 A12020/0125885 A1 * 4/2020 Hou....................... G06N 3/045examiner
US 2020/0175352 A12020/0175352 A1 6/2020 Cha
US 2020/0349370 A12020/0349370 A1 11/2020 Lambert
US 2020/0357196 A12020/0357196 A1 * 11/2020 Zhang................... G06F 18/253examiner
US 2021/0056753 A12021/0056753 A1 * 2/2021 Yasar..................... G06N 20/00examiner
US 2021/0174170 A12021/0174170 A1 * 6/2021 Tu........................... G06F 40/58examiner
US 2021/0174493 A12021/0174493 A1 * 6/2021 Xu......................... G06N 3/045examiner
US 2021/0334942 A12021/0334942 A1 * 10/2021 Wang........................ G06T 5/50examiner
US 2021/0341989 A12021/0341989 A1 * 11/2021 Chen....................... G06F 3/017examiner
US 2021/0383584 A12021/0383584 A1 * 12/2021 Zhang...................... G06N 3/08examiner
Cited non-patent literature · 2
Fast Object Localization Using a CNN Feature Map Based Multi-Scale Search. Hyungtae Lee et al.: “Fast Object Localization Using a CNN Feature Map Based Multi-Scale Search”, arxiv.org, Cornell Uni- versity Library, 201 Olin Library Cornell University Ithaca, NY 14853, Apr. 12, 2016, XP080695042, Section 3.2, Figure 3.
Image Classification Based on Region of Interest Detection. Zhou Huabing et al.: “Image Classification Based on Region of Interest Detection”, Visual Communications and Image Processing; Jan. 20, 2004; San Jose; vol. 9813, Dec. 14, 2015, pp. 9813OU- 9813OU, XP060063208, paragraph [0001]; figure 1. W. Samek, T. Wiegand, and K.- R. Muller. (2017). Explainable artificial Intelligence: understanding, visualizing and interpreting deep learning models.: [Online]. Available: https://arxiv.org/abs/1708.08296 (Year: 2017). Jeffery De Dejin, (“Automatic car damage recognition using con- volutional neural networks”, Internship report MSc Business Ana- lytics Mar. 29, 2018, pp. 1-53, Vrije UniversiteitAmsterdam Faculty of Science, Amsterdam)(Year:2018).
89
US 9,036,943 B19,036,943 B1 5/2015 Baldwin
US 9,582,843 B29,582,843 B2 2/2017 Leonard
US 9,607,138 B19,607,138 B1 3/2017 Baldwin
US 10,445,638 B110,445,638 B1 * 10/2019 Amirineni............... G06F 17/11examiner
US 10,475,014 B110,475,014 B1 11/2019 Ramalingam
US 10,554,738 B110,554,738 B1 2/2020 Ren
US 10,699,168 B110,699,168 B1 * 6/2020 Xu......................... G06Q 10/00examiner
US 10,846,716 B110,846,716 B1 * 11/2020 Chow................... G06T 7/0002examiner
US 11,138,292 B111,138,292 B1 * 10/2021 Nair....................... G06N 3/063examiner
US 2001/0046659 A12001/0046659 A1 11/2001 Oster
US 2002/0136459 A12002/0136459 A1 9/2002 Imagawa
US 2003/0229789 A12003/0229789 A1 12/2003 Morais
US 2004/0167765 A12004/0167765 A1 8/2004 Abu El Ata
US 2004/0196363 A12004/0196363 A1 10/2004 Diamond
US 2005/0232424 A12005/0232424 A1 10/2005 Dobranski
US 2009/0087025 A12009/0087025 A1 4/2009 Ma
US 2009/0206993 A12009/0206993 A1 8/2009 Di Mambro
US 2010/0128923 A12010/0128923 A1 5/2010 Kiya
US 2010/0135490 A12010/0135490 A1 6/2010 Kwon
US 2011/0069892 A12011/0069892 A1 3/2011 Tsai
US 2011/0162679 A12011/0162679 A1 7/2011 Demmeler
US 2012/0269346 A12012/0269346 A1 10/2012 Best
US 2013/0015946 A12013/0015946 A1 1/2013 Lau
US 2013/0182002 A12013/0182002 A1 7/2013 Macciola
US 2013/0208103 A12013/0208103 A1 8/2013 Sands
US 2013/0208956 A12013/0208956 A1 * 8/2013 Wehnes............... G06V 10/454examiner
US 2014/0037184 A12014/0037184 A1 2/2014 Gorski
US 2014/0270411 A12014/0270411 A1 9/2014 Shu
US 2014/0309805 A12014/0309805 A1 10/2014 Ricci
US 2014/0313334 A12014/0313334 A1 10/2014 Slotky
US 2015/0036891 A12015/0036891 A1 2/2015 Takenouchi
US 2015/0103170 A12015/0103170 A1 4/2015 Nelson
US 2015/0110364 A12015/0110364 A1 4/2015 Niinuma
US 2015/0110366 A12015/0110366 A1 4/2015 Sezille
US 2015/0341370 A12015/0341370 A1 11/2015 Khan
US 2016/0034786 A12016/0034786 A1 2/2016 Suri
US 2016/0044030 A12016/0044030 A1 2/2016 Galwas
US 2016/0063235 A12016/0063235 A1 3/2016 Tussy
US 2016/0283787 A12016/0283787 A1 9/2016 Nepomniachtchi
US 2016/0307029 A12016/0307029 A1 10/2016 Vaknin
US 2017/0048244 A12017/0048244 A1 2/2017 Loughlin-Mchugh
US 2017/0060867 A12017/0060867 A1 3/2017 Moutinho
US 2017/0061563 A12017/0061563 A1 3/2017 Falkenstern
US 2017/0148102 A12017/0148102 A1 5/2017 Franke
US 2017/0221110 A12017/0221110 A1 * 8/2017 Sullivan................. G06Q 10/20examiner
US 2017/0293894 A12017/0293894 A1 10/2017 Taliwal
US 2018/0047208 A12018/0047208 A1 2/2018 Marin
US 2018/0083973 A12018/0083973 A1 3/2018 Paraskevas
US 2018/0182039 A12018/0182039 A1 6/2018 Wang
US 2018/0247112 A12018/0247112 A1 8/2018 Norimatsu
US 2018/0260793 A12018/0260793 A1 * 9/2018 Li.......................... G06Q 40/08examiner
US 2018/0293552 A12018/0293552 A1 * 10/2018 Zhang.............. G06Q 10/06395examiner
US 2018/0293664 A12018/0293664 A1 * 10/2018 Zhang.................. G06V 10/454examiner
US 2018/0293806 A12018/0293806 A1 * 10/2018 Zhang...................... G06N 3/08examiner
US 2018/0300576 A12018/0300576 A1 10/2018 Dalyac
US 2019/0035112 A12019/0035112 A1 1/2019 Lee
US 2019/0073641 A12019/0073641 A1 3/2019 Utke
US 2019/0095877 A12019/0095877 A1 * 3/2019 Li.......................... G06V 20/63examiner
US 2019/0156178 A12019/0156178 A1 5/2019 Thornton
US 2019/0266015 A12019/0266015 A1 8/2019 Chandra
US 2019/0294878 A12019/0294878 A1 9/2019 Endras
US 2019/0355366 A12019/0355366 A1 11/2019 Ng
US 2020/0005151 A12020/0005151 A1 1/2020 Jiang
US 2020/0034958 A12020/0034958 A1 1/2020 Campbell
US 2020/0050867 A12020/0050867 A1 * 2/2020 Zhang.................... G06V 20/41examiner
US 2020/0050939 A12020/0050939 A1 2/2020 Zhu
US 2020/0051237 A12020/0051237 A1 2/2020 Spivey
US 2020/0065632 A12020/0065632 A1 * 2/2020 Guo....................... H04N 23/64examiner
US 2020/0074222 A12020/0074222 A1 * 3/2020 Guo......................... G06N 3/08examiner
US 2020/0074560 A12020/0074560 A1 * 3/2020 Xu........................... G06N 3/08examiner
US 2020/0125885 A12020/0125885 A1 * 4/2020 Hou....................... G06N 3/045examiner
US 2020/0175352 A12020/0175352 A1 6/2020 Cha
US 2020/0349370 A12020/0349370 A1 11/2020 Lambert
US 2020/0357196 A12020/0357196 A1 * 11/2020 Zhang................... G06F 18/253examiner
US 2021/0056753 A12021/0056753 A1 * 2/2021 Yasar..................... G06N 20/00examiner
US 2021/0174170 A12021/0174170 A1 * 6/2021 Tu........................... G06F 40/58examiner
US 2021/0174493 A12021/0174493 A1 * 6/2021 Xu......................... G06N 3/045examiner
US 2021/0334942 A12021/0334942 A1 * 10/2021 Wang........................ G06T 5/50examiner
US 2021/0341989 A12021/0341989 A1 * 11/2021 Chen....................... G06F 3/017examiner
US 2021/0383584 A12021/0383584 A1 * 12/2021 Zhang...................... G06N 3/08examiner
Cited non-patent literature · 2
Fast Object Localization Using a CNN Feature Map Based Multi-Scale Search. Hyungtae Lee et al.: “Fast Object Localization Using a CNN Feature Map Based Multi-Scale Search”, arxiv.org, Cornell Uni- versity Library, 201 Olin Library Cornell University Ithaca, NY 14853, Apr. 12, 2016, XP080695042, Section 3.2, Figure 3.
Image Classification Based on Region of Interest Detection. Zhou Huabing et al.: “Image Classification Based on Region of Interest Detection”, Visual Communications and Image Processing; Jan. 20, 2004; San Jose; vol. 9813, Dec. 14, 2015, pp. 9813OU- 9813OU, XP060063208, paragraph [0001]; figure 1. W. Samek, T. Wiegand, and K.- R. Muller. (2017). Explainable artificial Intelligence: understanding, visualizing and interpreting deep learning models.: [Online]. Available: https://arxiv.org/abs/1708.08296 (Year: 2017). Jeffery De Dejin, (“Automatic car damage recognition using con- volutional neural networks”, Internship report MSc Business Ana- lytics Mar. 29, 2018, pp. 1-53, Vrije UniversiteitAmsterdam Faculty of Science, Amsterdam)(Year:2018).
89
US 9,036,943 B19,036,943 B1 5/2015 Baldwin
US 9,582,843 B29,582,843 B2 2/2017 Leonard
US 9,607,138 B19,607,138 B1 3/2017 Baldwin
US 10,445,638 B110,445,638 B1 * 10/2019 Amirineni............... G06F 17/11examiner
US 10,475,014 B110,475,014 B1 11/2019 Ramalingam
US 10,554,738 B110,554,738 B1 2/2020 Ren
US 10,699,168 B110,699,168 B1 * 6/2020 Xu......................... G06Q 10/00examiner
US 10,846,716 B110,846,716 B1 * 11/2020 Chow................... G06T 7/0002examiner
US 11,138,292 B111,138,292 B1 * 10/2021 Nair....................... G06N 3/063examiner
US 2001/0046659 A12001/0046659 A1 11/2001 Oster
US 2002/0136459 A12002/0136459 A1 9/2002 Imagawa
US 2003/0229789 A12003/0229789 A1 12/2003 Morais
US 2004/0167765 A12004/0167765 A1 8/2004 Abu El Ata
US 2004/0196363 A12004/0196363 A1 10/2004 Diamond
US 2005/0232424 A12005/0232424 A1 10/2005 Dobranski
US 2009/0087025 A12009/0087025 A1 4/2009 Ma
US 2009/0206993 A12009/0206993 A1 8/2009 Di Mambro
US 2010/0128923 A12010/0128923 A1 5/2010 Kiya
US 2010/0135490 A12010/0135490 A1 6/2010 Kwon
US 2011/0069892 A12011/0069892 A1 3/2011 Tsai
US 2011/0162679 A12011/0162679 A1 7/2011 Demmeler
US 2012/0269346 A12012/0269346 A1 10/2012 Best
US 2013/0015946 A12013/0015946 A1 1/2013 Lau
US 2013/0182002 A12013/0182002 A1 7/2013 Macciola
US 2013/0208103 A12013/0208103 A1 8/2013 Sands
US 2013/0208956 A12013/0208956 A1 * 8/2013 Wehnes............... G06V 10/454examiner
US 2014/0037184 A12014/0037184 A1 2/2014 Gorski
US 2014/0270411 A12014/0270411 A1 9/2014 Shu
US 2014/0309805 A12014/0309805 A1 10/2014 Ricci
US 2014/0313334 A12014/0313334 A1 10/2014 Slotky
US 2015/0036891 A12015/0036891 A1 2/2015 Takenouchi
US 2015/0103170 A12015/0103170 A1 4/2015 Nelson
US 2015/0110364 A12015/0110364 A1 4/2015 Niinuma
US 2015/0110366 A12015/0110366 A1 4/2015 Sezille
US 2015/0341370 A12015/0341370 A1 11/2015 Khan
US 2016/0034786 A12016/0034786 A1 2/2016 Suri
US 2016/0044030 A12016/0044030 A1 2/2016 Galwas
US 2016/0063235 A12016/0063235 A1 3/2016 Tussy
US 2016/0283787 A12016/0283787 A1 9/2016 Nepomniachtchi
US 2016/0307029 A12016/0307029 A1 10/2016 Vaknin
US 2017/0048244 A12017/0048244 A1 2/2017 Loughlin-Mchugh
US 2017/0060867 A12017/0060867 A1 3/2017 Moutinho
US 2017/0061563 A12017/0061563 A1 3/2017 Falkenstern
US 2017/0148102 A12017/0148102 A1 5/2017 Franke
US 2017/0221110 A12017/0221110 A1 * 8/2017 Sullivan................. G06Q 10/20examiner
US 2017/0293894 A12017/0293894 A1 10/2017 Taliwal
US 2018/0047208 A12018/0047208 A1 2/2018 Marin
US 2018/0083973 A12018/0083973 A1 3/2018 Paraskevas
US 2018/0182039 A12018/0182039 A1 6/2018 Wang
US 2018/0247112 A12018/0247112 A1 8/2018 Norimatsu
US 2018/0260793 A12018/0260793 A1 * 9/2018 Li.......................... G06Q 40/08examiner
US 2018/0293552 A12018/0293552 A1 * 10/2018 Zhang.............. G06Q 10/06395examiner
US 2018/0293664 A12018/0293664 A1 * 10/2018 Zhang.................. G06V 10/454examiner
US 2018/0293806 A12018/0293806 A1 * 10/2018 Zhang...................... G06N 3/08examiner
US 2018/0300576 A12018/0300576 A1 10/2018 Dalyac
US 2019/0035112 A12019/0035112 A1 1/2019 Lee
US 2019/0073641 A12019/0073641 A1 3/2019 Utke
US 2019/0095877 A12019/0095877 A1 * 3/2019 Li.......................... G06V 20/63examiner
US 2019/0156178 A12019/0156178 A1 5/2019 Thornton
US 2019/0266015 A12019/0266015 A1 8/2019 Chandra
US 2019/0294878 A12019/0294878 A1 9/2019 Endras
US 2019/0355366 A12019/0355366 A1 11/2019 Ng
US 2020/0005151 A12020/0005151 A1 1/2020 Jiang
US 2020/0034958 A12020/0034958 A1 1/2020 Campbell
US 2020/0050867 A12020/0050867 A1 * 2/2020 Zhang.................... G06V 20/41examiner
US 2020/0050939 A12020/0050939 A1 2/2020 Zhu
US 2020/0051237 A12020/0051237 A1 2/2020 Spivey
US 2020/0065632 A12020/0065632 A1 * 2/2020 Guo....................... H04N 23/64examiner
US 2020/0074222 A12020/0074222 A1 * 3/2020 Guo......................... G06N 3/08examiner
US 2020/0074560 A12020/0074560 A1 * 3/2020 Xu........................... G06N 3/08examiner
US 2020/0125885 A12020/0125885 A1 * 4/2020 Hou....................... G06N 3/045examiner
US 2020/0175352 A12020/0175352 A1 6/2020 Cha
US 2020/0349370 A12020/0349370 A1 11/2020 Lambert
US 2020/0357196 A12020/0357196 A1 * 11/2020 Zhang................... G06F 18/253examiner
US 2021/0056753 A12021/0056753 A1 * 2/2021 Yasar..................... G06N 20/00examiner
US 2021/0174170 A12021/0174170 A1 * 6/2021 Tu........................... G06F 40/58examiner
US 2021/0174493 A12021/0174493 A1 * 6/2021 Xu......................... G06N 3/045examiner
US 2021/0334942 A12021/0334942 A1 * 10/2021 Wang........................ G06T 5/50examiner
US 2021/0341989 A12021/0341989 A1 * 11/2021 Chen....................... G06F 3/017examiner
US 2021/0383584 A12021/0383584 A1 * 12/2021 Zhang...................... G06N 3/08examiner
Cited non-patent literature · 2
Fast Object Localization Using a CNN Feature Map Based Multi-Scale Search. Hyungtae Lee et al.: “Fast Object Localization Using a CNN Feature Map Based Multi-Scale Search”, arxiv.org, Cornell Uni- versity Library, 201 Olin Library Cornell University Ithaca, NY 14853, Apr. 12, 2016, XP080695042, Section 3.2, Figure 3.
Image Classification Based on Region of Interest Detection. Zhou Huabing et al.: “Image Classification Based on Region of Interest Detection”, Visual Communications and Image Processing; Jan. 20, 2004; San Jose; vol. 9813, Dec. 14, 2015, pp. 9813OU- 9813OU, XP060063208, paragraph [0001]; figure 1. W. Samek, T. Wiegand, and K.- R. Muller. (2017). Explainable artificial Intelligence: understanding, visualizing and interpreting deep learning models.: [Online]. Available: https://arxiv.org/abs/1708.08296 (Year: 2017). Jeffery De Dejin, (“Automatic car damage recognition using con- volutional neural networks”, Internship report MSc Business Ana- lytics Mar. 29, 2018, pp. 1-53, Vrije UniversiteitAmsterdam Faculty of Science, Amsterdam)(Year:2018).
89
US 9,036,943 B19,036,943 B1 5/2015 Baldwin
US 9,582,843 B29,582,843 B2 2/2017 Leonard
US 9,607,138 B19,607,138 B1 3/2017 Baldwin
US 10,445,638 B110,445,638 B1 * 10/2019 Amirineni............... G06F 17/11examiner
US 10,475,014 B110,475,014 B1 11/2019 Ramalingam
US 10,554,738 B110,554,738 B1 2/2020 Ren
US 10,699,168 B110,699,168 B1 * 6/2020 Xu......................... G06Q 10/00examiner
US 10,846,716 B110,846,716 B1 * 11/2020 Chow................... G06T 7/0002examiner
US 11,138,292 B111,138,292 B1 * 10/2021 Nair....................... G06N 3/063examiner
US 2001/0046659 A12001/0046659 A1 11/2001 Oster
US 2002/0136459 A12002/0136459 A1 9/2002 Imagawa
US 2003/0229789 A12003/0229789 A1 12/2003 Morais
US 2004/0167765 A12004/0167765 A1 8/2004 Abu El Ata
US 2004/0196363 A12004/0196363 A1 10/2004 Diamond
US 2005/0232424 A12005/0232424 A1 10/2005 Dobranski
US 2009/0087025 A12009/0087025 A1 4/2009 Ma
US 2009/0206993 A12009/0206993 A1 8/2009 Di Mambro
US 2010/0128923 A12010/0128923 A1 5/2010 Kiya
US 2010/0135490 A12010/0135490 A1 6/2010 Kwon
US 2011/0069892 A12011/0069892 A1 3/2011 Tsai
US 2011/0162679 A12011/0162679 A1 7/2011 Demmeler
US 2012/0269346 A12012/0269346 A1 10/2012 Best
US 2013/0015946 A12013/0015946 A1 1/2013 Lau
US 2013/0182002 A12013/0182002 A1 7/2013 Macciola
US 2013/0208103 A12013/0208103 A1 8/2013 Sands
US 2013/0208956 A12013/0208956 A1 * 8/2013 Wehnes............... G06V 10/454examiner
US 2014/0037184 A12014/0037184 A1 2/2014 Gorski
US 2014/0270411 A12014/0270411 A1 9/2014 Shu
US 2014/0309805 A12014/0309805 A1 10/2014 Ricci
US 2014/0313334 A12014/0313334 A1 10/2014 Slotky
US 2015/0036891 A12015/0036891 A1 2/2015 Takenouchi
US 2015/0103170 A12015/0103170 A1 4/2015 Nelson
US 2015/0110364 A12015/0110364 A1 4/2015 Niinuma
US 2015/0110366 A12015/0110366 A1 4/2015 Sezille
US 2015/0341370 A12015/0341370 A1 11/2015 Khan
US 2016/0034786 A12016/0034786 A1 2/2016 Suri
US 2016/0044030 A12016/0044030 A1 2/2016 Galwas
US 2016/0063235 A12016/0063235 A1 3/2016 Tussy
US 2016/0283787 A12016/0283787 A1 9/2016 Nepomniachtchi
US 2016/0307029 A12016/0307029 A1 10/2016 Vaknin
US 2017/0048244 A12017/0048244 A1 2/2017 Loughlin-Mchugh
US 2017/0060867 A12017/0060867 A1 3/2017 Moutinho
US 2017/0061563 A12017/0061563 A1 3/2017 Falkenstern
US 2017/0148102 A12017/0148102 A1 5/2017 Franke
US 2017/0221110 A12017/0221110 A1 * 8/2017 Sullivan................. G06Q 10/20examiner
US 2017/0293894 A12017/0293894 A1 10/2017 Taliwal
US 2018/0047208 A12018/0047208 A1 2/2018 Marin
US 2018/0083973 A12018/0083973 A1 3/2018 Paraskevas
US 2018/0182039 A12018/0182039 A1 6/2018 Wang
US 2018/0247112 A12018/0247112 A1 8/2018 Norimatsu
US 2018/0260793 A12018/0260793 A1 * 9/2018 Li.......................... G06Q 40/08examiner
US 2018/0293552 A12018/0293552 A1 * 10/2018 Zhang.............. G06Q 10/06395examiner
US 2018/0293664 A12018/0293664 A1 * 10/2018 Zhang.................. G06V 10/454examiner
US 2018/0293806 A12018/0293806 A1 * 10/2018 Zhang...................... G06N 3/08examiner
US 2018/0300576 A12018/0300576 A1 10/2018 Dalyac
US 2019/0035112 A12019/0035112 A1 1/2019 Lee
US 2019/0073641 A12019/0073641 A1 3/2019 Utke
US 2019/0095877 A12019/0095877 A1 * 3/2019 Li.......................... G06V 20/63examiner
US 2019/0156178 A12019/0156178 A1 5/2019 Thornton
US 2019/0266015 A12019/0266015 A1 8/2019 Chandra
US 2019/0294878 A12019/0294878 A1 9/2019 Endras
US 2019/0355366 A12019/0355366 A1 11/2019 Ng
US 2020/0005151 A12020/0005151 A1 1/2020 Jiang
US 2020/0034958 A12020/0034958 A1 1/2020 Campbell
US 2020/0050867 A12020/0050867 A1 * 2/2020 Zhang.................... G06V 20/41examiner
US 2020/0050939 A12020/0050939 A1 2/2020 Zhu
US 2020/0051237 A12020/0051237 A1 2/2020 Spivey
US 2020/0065632 A12020/0065632 A1 * 2/2020 Guo....................... H04N 23/64examiner
US 2020/0074222 A12020/0074222 A1 * 3/2020 Guo......................... G06N 3/08examiner
US 2020/0074560 A12020/0074560 A1 * 3/2020 Xu........................... G06N 3/08examiner
US 2020/0125885 A12020/0125885 A1 * 4/2020 Hou....................... G06N 3/045examiner
US 2020/0175352 A12020/0175352 A1 6/2020 Cha
US 2020/0349370 A12020/0349370 A1 11/2020 Lambert
US 2020/0357196 A12020/0357196 A1 * 11/2020 Zhang................... G06F 18/253examiner
US 2021/0056753 A12021/0056753 A1 * 2/2021 Yasar..................... G06N 20/00examiner
US 2021/0174170 A12021/0174170 A1 * 6/2021 Tu........................... G06F 40/58examiner
US 2021/0174493 A12021/0174493 A1 * 6/2021 Xu......................... G06N 3/045examiner
US 2021/0334942 A12021/0334942 A1 * 10/2021 Wang........................ G06T 5/50examiner
US 2021/0341989 A12021/0341989 A1 * 11/2021 Chen....................... G06F 3/017examiner
US 2021/0383584 A12021/0383584 A1 * 12/2021 Zhang...................... G06N 3/08examiner
Cited non-patent literature · 2
Fast Object Localization Using a CNN Feature Map Based Multi-Scale Search. Hyungtae Lee et al.: “Fast Object Localization Using a CNN Feature Map Based Multi-Scale Search”, arxiv.org, Cornell Uni- versity Library, 201 Olin Library Cornell University Ithaca, NY 14853, Apr. 12, 2016, XP080695042, Section 3.2, Figure 3.
Image Classification Based on Region of Interest Detection. Zhou Huabing et al.: “Image Classification Based on Region of Interest Detection”, Visual Communications and Image Processing; Jan. 20, 2004; San Jose; vol. 9813, Dec. 14, 2015, pp. 9813OU- 9813OU, XP060063208, paragraph [0001]; figure 1. W. Samek, T. Wiegand, and K.- R. Muller. (2017). Explainable artificial Intelligence: understanding, visualizing and interpreting deep learning models.: [Online]. Available: https://arxiv.org/abs/1708.08296 (Year: 2017). Jeffery De Dejin, (“Automatic car damage recognition using con- volutional neural networks”, Internship report MSc Business Ana- lytics Mar. 29, 2018, pp. 1-53, Vrije UniversiteitAmsterdam Faculty of Science, Amsterdam)(Year:2018).