{"id":493,"date":"2013-04-25T23:04:49","date_gmt":"2013-04-26T04:04:49","guid":{"rendered":"http:\/\/projects.vrac.iastate.edu\/ewiner\/?page_id=493"},"modified":"2013-05-02T18:47:23","modified_gmt":"2013-05-02T23:47:23","slug":"3dvision","status":"publish","type":"page","link":"https:\/\/projects.vrac.iastate.edu\/ewiner\/3dvision\/","title":{"rendered":"3DVision"},"content":{"rendered":"<p>High-resolution, Real-time 3-D Shape Measurement for Particle Motion Capture<\/p>\n<p>This project aims to study the methodology for capturing and measuring particles by means of a structured light based camera to create depth images and computer vision techniques to process these depth images for particle analysis.<\/p>\n<p>Many CFD simulations are based on ideal conditions and assumptions. Measurements of physical parameters like wind speed, material weight etc. are all possible however at the end of the day they do not give us the results we expect. However basing multimillion dollar projects on simulations which may or may not be right is not ideal. Thus we introduce a new technique by which we can analyze experimentally how particles move in a real environment and verify simulations accordingly.<\/p>\n<p>We have developed a camera based on structured light, where the deformation of the fringe patterns around an object allows for accurate calculations of depth.<\/p>\n<figure id=\"attachment_495\" aria-describedby=\"caption-attachment-495\" style=\"width: 305px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-495\" alt=\"Structured Light process of getting Depth Images\" src=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision2.png\" width=\"315\" height=\"310\" srcset=\"https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision2.png 590w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision2-300x295.png 300w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision2-24x24.png 24w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision2-36x36.png 36w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision2-48x48.png 48w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision2-64x64.png 64w\" sizes=\"auto, (max-width: 315px) 100vw, 315px\" \/><\/a><figcaption id=\"caption-attachment-495\" class=\"wp-caption-text\">Structured Light process of getting Depth Images<\/figcaption><\/figure>\n<figure id=\"attachment_494\" aria-describedby=\"caption-attachment-494\" style=\"width: 314px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-494\" alt=\"Camera and Projector Setup\" src=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision1.png\" width=\"324\" height=\"312\" srcset=\"https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision1-24x24.png 24w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision1-36x36.png 36w\" sizes=\"auto, (max-width: 324px) 100vw, 324px\" \/><\/a><figcaption id=\"caption-attachment-494\" class=\"wp-caption-text\">Camera and Projector Setup<\/figcaption><\/figure>\n<figure id=\"attachment_496\" aria-describedby=\"caption-attachment-496\" style=\"width: 279px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision3.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-496\" alt=\"Example Fringe Pattern with target particles\" src=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision3.png\" width=\"289\" height=\"289\" srcset=\"https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision3.png 576w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision3-150x150.png 150w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision3-300x300.png 300w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision3-96x96.png 96w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision3-24x24.png 24w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision3-36x36.png 36w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision3-48x48.png 48w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision3-64x64.png 64w\" sizes=\"auto, (max-width: 289px) 100vw, 289px\" \/><\/a><figcaption id=\"caption-attachment-496\" class=\"wp-caption-text\">Example Fringe Pattern with target particles<\/figcaption><\/figure>\n<figure id=\"attachment_497\" aria-describedby=\"caption-attachment-497\" style=\"width: 389px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision4.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-497 \" alt=\"3Dvision4\" src=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision4.png\" width=\"399\" height=\"291\" srcset=\"https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision4.png 560w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision4-300x218.png 300w\" sizes=\"auto, (max-width: 399px) 100vw, 399px\" \/><\/a><figcaption id=\"caption-attachment-497\" class=\"wp-caption-text\">3D Depth<\/figcaption><\/figure>\n<p>Being an optical device, they are noisy and are easily affected by other sources of light. This leads to artifacts in the data and inaccuracies in our calculations. We overcome these problems using the following method.<br \/>\n\u2022 Perform a series of erosion&#8217;s and dilation&#8217;s so that smaller artifacts get removed<br \/>\n\u2022 Extract the boundaries of the various particles and remove any of them which are smaller than a particular threshold<\/p>\n<figure id=\"attachment_498\" aria-describedby=\"caption-attachment-498\" style=\"width: 543px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision5.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-498\" alt=\"Depth Map showing Noise and Target Particles \" src=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision5-1024x565.png\" width=\"553\" height=\"304\" srcset=\"https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision5-1024x565.png 1024w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision5-300x165.png 300w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision5.png 1149w\" sizes=\"auto, (max-width: 553px) 100vw, 553px\" \/><\/a><figcaption id=\"caption-attachment-498\" class=\"wp-caption-text\">Depth Map showing Noise and Target Particles<\/figcaption><\/figure>\n<p>The goal of this project is not just to detect the particles but to track their trajectories also. Particle tracking is a very hard problem as it has to overcome the primary issue of occlusions. For this we developed our own algorithm which is as follows<br \/>\n\u2022 Extract the centroids of each particle in each frame<br \/>\n\u2022 Using contours from the previous and current frame we determine the centroid position of each particle<br \/>\n\u2022 By essentially following each particle\u2019s position we are able to trace out their trajectory<br \/>\n\u2022 Occlusions are dealt with by considering the \u201cage\u201d of a particle Particle\u2019s age is replaced by newer particles closely matching position In the current frame. Younger contours are those which are visible while older ones are those which disappear. After a certain threshold age, the contour is assumed to be out of the frame.<\/p>\n<figure id=\"attachment_499\" aria-describedby=\"caption-attachment-499\" style=\"width: 494px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision6.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-499\" alt=\"Target Particles Acquired (shown by red boundary and green centroids)\" src=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision6-1024x631.png\" width=\"504\" height=\"310\" srcset=\"https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision6-1024x631.png 1024w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision6-300x185.png 300w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision6.png 1083w\" sizes=\"auto, (max-width: 504px) 100vw, 504px\" \/><\/a><figcaption id=\"caption-attachment-499\" class=\"wp-caption-text\">Target Particles Acquired (shown by red boundary and green centroids)<\/figcaption><\/figure>\n<p>Using all the information we have with us we are able to make analyse and visualise the data in an immersive environment and bring about an understanding which is harder to realize through other forms of visualisations like charts and graphs.<\/p>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_500\" aria-describedby=\"caption-attachment-500\" style=\"width: 568px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision7.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-500\" alt=\"Final Immersive Application\" src=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision7.png\" width=\"578\" height=\"422\" srcset=\"https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision7.png 815w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision7-300x219.png 300w\" sizes=\"auto, (max-width: 578px) 100vw, 578px\" \/><\/a><figcaption id=\"caption-attachment-500\" class=\"wp-caption-text\">Final Immersive Application<\/figcaption><\/figure>\n<p align=\"center\">\n<p>We show you an example of the data we captured and display it in front of a model tractor.<\/p>\n<p>Future Work<\/p>\n<p>Below is a rudimentary example of an algorithm we are developing to get the centroids of each particle even when they are stuck with other particles. With this we hope to develop better tracking algorithms and better particle analysis.<\/p>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_501\" aria-describedby=\"caption-attachment-501\" style=\"width: 544px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision8.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-501\" alt=\"Individual Particles found\" src=\"http:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision8.png\" width=\"554\" height=\"559\" srcset=\"https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision8.png 619w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision8-150x150.png 150w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision8-297x300.png 297w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision8-96x96.png 96w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision8-24x24.png 24w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision8-36x36.png 36w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision8-48x48.png 48w, https:\/\/projects.vrac.iastate.edu\/ewiner\/files\/2013\/04\/3Dvision8-64x64.png 64w\" sizes=\"auto, (max-width: 554px) 100vw, 554px\" \/><\/a><figcaption id=\"caption-attachment-501\" class=\"wp-caption-text\">Individual Particles found<\/figcaption><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>High-resolution, Real-time 3-D Shape Measurement for Particle Motion Capture This project aims to study the methodology for capturing and measuring particles by means of a structured light based camera to create depth images and computer vision techniques to process these depth images for particle analysis. Many CFD simulations are based on ideal conditions and assumptions. &#8230; <a title=\"3DVision\" class=\"read-more\" href=\"https:\/\/projects.vrac.iastate.edu\/ewiner\/3dvision\/\" aria-label=\"Read more about 3DVision\">Read more<\/a><\/p>\n","protected":false},"author":23,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"class_list":["post-493","page","type-page","status-publish"],"acf":[],"_links":{"self":[{"href":"https:\/\/projects.vrac.iastate.edu\/ewiner\/wp-json\/wp\/v2\/pages\/493","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/projects.vrac.iastate.edu\/ewiner\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/projects.vrac.iastate.edu\/ewiner\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/projects.vrac.iastate.edu\/ewiner\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/projects.vrac.iastate.edu\/ewiner\/wp-json\/wp\/v2\/comments?post=493"}],"version-history":[{"count":20,"href":"https:\/\/projects.vrac.iastate.edu\/ewiner\/wp-json\/wp\/v2\/pages\/493\/revisions"}],"predecessor-version":[{"id":503,"href":"https:\/\/projects.vrac.iastate.edu\/ewiner\/wp-json\/wp\/v2\/pages\/493\/revisions\/503"}],"wp:attachment":[{"href":"https:\/\/projects.vrac.iastate.edu\/ewiner\/wp-json\/wp\/v2\/media?parent=493"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}