6D pose estimation of textureless shiny objects has become an essential problem in many robotic applications. Many pose estimators require high-quality depth data, often measured by structured light cameras. However, when objects have shiny surfaces (e.g., metal parts), these cameras fail to sense complete depths from a single viewpoint due to the specular reflection, resulting in a significant drop in the final pose accuracy. We are thrilled to share that our latest research has been accepted to #IROS2024! 🎉 In our paper, "Active Pose Refinement for Textureless Shiny Objects using the Structured Light Camera," co-authored by Yang J., Jian Yao, and Steven Lake Waslander, we present a complete active vision framework for 6D object pose refinement and next-best view prediction to mitigate the aforementioned issue. 🌟 Key Highlights 🌟: - Innovative 6D Pose Refinement: Our approach is tailored for SLI cameras and includes estimating pixel depth uncertainties and integrating these estimates into our SDF-based pose refinement module. - Surface Reflection Model: We predict depth uncertainties for unseen viewpoints using a reflection model that recovers object reflection parameters with a differentiable renderer. - Active Vision System: By integrating our reflection model and pose refinement approach, we can predict the next-best view (NBV) for pose estimation through online rendering. Check out the full paper linked below and join us at #IROS2024! Paper: https://lnkd.in/gMTHZVcY A big thank you to Epson Canada for supporting this work! #poseestimation #robotics #sli #structuredlightcamera
Toronto Robotics and Artificial Intelligence Laboratory’s Post
More Relevant Posts
-
Looking for reliable and flexible solutions for Robot Guidance? Balluff have you covered!! 3D stereo cameras add a layer of depth and provide a practical solution for some complex applications. With 12-megapixel resolution and a frame rate of up to nine images per second, the new 3D stereo camera from #Balluff enables highly accurate 3D image processing, even with moving objects. 💨💨 The new BVS 3D_RV1 3D was specifically developed for detecting and handling small and complex parts, even in large detection areas. Adjustable lenses and a built-in projector provide optimal image results for most workspaces. Ideal work areas include: – Assembly Machines – Robotics – Automation – Intralogistics – Metalworking The camera operates according to the GigE Vision standard and uses a GenICAM-compatible software interface. A robust housing with an IP54 protection rating makes the camera suitable for harsh industrial environments such as metalworking, machine assembly, and intralogistics. Features 📸 GigE Vision interface for high flexibility 📸 IP54 rating for use in harsh environments 📸 12 MP resolution 📸 Adjustable lenses on the camera and projector Click https://lnkd.in/eb47miYP #Balluff #InnovatingAutomation #3dStereoCamera #MachineVision #IndustrialMachineVision
To view or add a comment, sign in
-
NEW PRODUCT // Industrial machine vision has come a long way! 3D stereo cameras add a layer of depth and provide a practical solution for some complex applications. With 12-megapixel resolution and a frame rate of up to nine images per second, the new 3D stereo camera from #Balluff enables highly accurate 3D image processing, even with moving objects. 💨💨 The new BVS 3D_RV1 3D was specifically developed for detecting and handling small and complex parts, even in large detection areas. Adjustable lenses and a built-in projector provide optimal image results for most workspaces. Ideal work areas include: – Assembly Machines – Robotics – Automation – Intralogistics – Metalworking The camera operates according to the GigE Vision standard and uses a GenICAM-compatible software interface. A robust housing with an IP54 protection rating makes the camera suitable for harsh industrial environments such as metalworking, machine assembly, and intralogistics. Features 📸 GigE Vision interface for high flexibility 📸 IP54 rating for use in harsh environments 📸 12 MP resolution 📸 Adjustable lenses on the camera and projector Click https://lnkd.in/g33myDXr for more information. #Balluff #InnovatingAutomation #3dStereoCamera #MachineVision #IndustrialMachineVision
New 12-Megapixel 3D Stereo Camera Delivers High Resolution Results - Balluff
balluff.com
To view or add a comment, sign in
-
Ever wondered if you can digitize something the size of a truck? Find out how Artec Leo and Artec Ray II can be combined to capture huge areas and objects in high resolution via my latest Artec 3D case study. With Artec 3D scanning, AirShaper has captured the fine details of a truck so effectively, that the resulting mesh could be used to identify design upgrades. Check out the full story (and a 3D model of said truck) using the link below! https://lnkd.in/eKPWF3Zx
Multi-resolution Leo & Artec Ray II 3D scanning unlocks fuel efficiency gains
artec3d.com
To view or add a comment, sign in
-
The Visionary-T Mini AP from SICK is a cost-effective 3D machine vision solution for logistics, robotics or industrial vehicles that is very easy to configure. By combining the Visionary-T Mini AP camera with the Sick Nova 3D Presence Inspection SensorApp, the configuration of machine vision inspections in 3D is now possible in a single snapshot. The camera uses time-of-flight snapshot technology for detailed environment detection at high production speeds. It captures both the 3D depth and 2D intensity values of each pixel with exceptional resolution (512 × 424 px) in a single light beam and at up to 30 3D images per second. With their simple operation and high data quality, the compact 3D snapshot cameras are therefore the answer to almost all industrial 3D machine vision requirements. Thanks to 3D time-of-flight technology, every pixel delivers the most accurate depth and intensity data. The camera captures the environment extremely reliably, even with strong light/dark contrast and a wide distance range, and its very short image recording time enables precise data to be captured even from moving objects. A clear configuration tool is used for simple parameterization and flexible, application-specific adaptation of the data. Common 3D inspection tasks in factory automation and logistics, such as completeness checks, fill level checks or palletizing by robots, can be set up quickly and cost-effectively on the Visionary-T Mini AP camera using the Sick Nova 3D Presence Inspection SensorApp. The user selects the required 3D image processing tools via a simple graphical user interface and immediately the Visionary-T Mini AP camera delivers reliable inspection results via I/O to the machine controller or via TCP/IP. The Sick Nova Presence Inspection App has a toolset of common 3D vision tools to easily handle tasks such as empty container, bin and crate inspection, presence detection of objects in 3D scenes as well as simple measurements and quality tolerance checks. With Sick Nova Presence Inspection on the Visionary-T Mini, the position, height and volume of any package can be determined so that it can be picked up by a robot and placed in a container or pallet, for example. The Visionary-T Mini's 3D snapshot technology can also be used for continuous 3D fill level monitoring, for example to determine whether containers are empty, full, full or overfilled, or to measure the presence of parts in a container or the presence of ingredients in a jar. https://lnkd.in/dUDeWTiE #sensor #camera #3D #measurement #quality #inspection #logistics #tof #robotics #industry #processautomation #qualitycontrol #electronics #distribution
Visionary-T Mini: 3D ToF camera solving industrial applications
https://www.youtube.com/
To view or add a comment, sign in
-
I am thrilled to share that our paper "G.O.G: A Versatile Gripper-On-Gripper Design for Bimanual Cloth Manipulation with a Single Robotic Arm" has been accepted for publication in IEEE Robotics and Automation Letters! 👏 In this paper, we introduce a novel gripper design, called G.O.G, specifically designed to facilitate bimanual cloth manipulation, including actions like folding and flattening, using only a single robot arm. Our gripper configuration comprises two distinct features: a Width Control Gripper (WCG) and two Variable Friction Grippers (VFG). The WCG functions as a large-scale gripper mechanism responsible for regulating the width of the two VFGs, with a range of up to 500mm. The two VFGs consist of a variable friction module that enables to actuate two grasping modes passively - firm and sliding grasps. While employing a dual-arm system would typically increase overall control complexity and cost, our gripper design allows for the implementation of complex bimanual manipulation by effectively controlling the pose and opening width of the gripper. For more in-depth information, please refer to our paper "G.O.G: A Versatile Gripper-On-Gripper Design for Bimanual Cloth Manipulation with a Single Robotic Arm" by Dongmyoung Lee, Wei C., Xiaoshuai Chen, and Nicolas Rojas. We will release the CAD files of G.O.G soon. Please feel free to approach me if you have any questions regarding this work! Paper (arXiv): https://lnkd.in/e2cRnCpr Paper (IEEE): https://lnkd.in/eVvPZ87y Video: https://lnkd.in/eXVwXWtH Webpage: https://lnkd.in/eT8xnr8d #IROS #IROS2024 #IEEE #RAL #Manipulation #Robotics
To view or add a comment, sign in
-
Unleash Innovation: Elevate your experience with the Ultimate Speed of I Mark 3, the Optical Whiteness of 3D Marking, and the Natural look of Fabro-Tech. Enhanced by Unique Laser Tube Technology and accelerated by a new super-fast electronic controller card – redefining precision and efficiency in every detail. #vavtechnology #sustainabledenim #sustainablefashion #denimdesign #denimlaundry #lasermachine #roboticsystems
To view or add a comment, sign in
-
3D in-cabin monitoring with a 2D camera?! Neonode’s AI software for next-level machine vision ipXchange had a few encounters with Neonode in 2023, so catching up with their team at CES 2024 was a must, and what a demo they had on show! In the first of two interviews, Guy chats with Per about Neonode’s hardware-agnostic software platform that enables high-quality, 3D machine perception using commodity 2D camera systems. Thanks to the vast range of trained models, this software can easily determine the position of drivers and passengers in a car, for example, with full-body gesture recognition, drowsiness detection, and more. It is this functionality that makes Neonode’s technology such a scalable solution for new European automotive safety standards, and it is therefore well worth a look – all puns intended. But that’s not all! Check out the full interview and technical writeup on the ipXchange website, where you can also apply to evaluate this technology for use in a commercial application: https://lnkd.in/g8CKP97P Keep designing! #automotivesafety #automotive #incabinmonitoring #automotiveelectronics #electronics #electronicsengineering #sensor #linux #ASPICE #automotivecamera #softwaresolutions #automotivesoftware #machinevision #machineperception
3D in-cabin monitoring with a 2D camera!
https://ipxchange.tech
To view or add a comment, sign in
-
I craft practical systems and solutions for Projects | Add value to Customer | Deliver results and success | Inspired by My Father’s Vision | Want to connect!? 🤝
🌟 Introducing the #VisionaryTMini : Revolutionizing Industrial 3D Machine Vision! 📸🔍 Unlock unparalleled accuracy and efficiency in industrial automation with the Visionary-T Mini 3D snapshot cameras from SICK! ✨ Advanced 3D Time-of-Flight Technology: Each pixel delivers extremely accurate depth and intensity data, ensuring precise object detection even in challenging light conditions and at long distances. 💡 Simple Operation, Excellent Data Quality: With its user-friendly interface and superior data quality, the Visionary-T Mini provides the perfect solution for diverse industrial applications. 🔧 Flexible Configuration: Easily adapt the device to your specific application with the clearly structured configuration tool, making it an ideal, cost-efficient solution for logistics, robotics, and industrial vehicles. 💼 Software Solutions: Seamlessly integrate the Visionary-T Mini with suitable software solutions from SICK, including 3D Object Detection, SICK Nova, Pallet Pocket Detection, and more! Experience innovation in action and elevate your industrial processes to new heights.🚀💼 #industrialautomation #innovation #efficiencyredefined #safety #sicksensorintelligence #machinevision #3dvision
To view or add a comment, sign in
-
"Created by nature, the human skin shows powerful sensing capabilities that have been pursued by scientists for a very long time. However, it is challenging for today's technologies to replicate the spatial arrangement of the complex 3D microstructure of human skin. A research team led by Professor Yihui Zhang from Tsinghua University has developed a three-dimensionally architected electronic skin that mimics human mechanosensation for fully-decoupled sensing of normal force, shear force and strain." #eskin #electronicskin #robotics
New electronic skin mimics human touch with 3D architecture
techxplore.com
To view or add a comment, sign in
-
Exciting News! 📚 Our recent publication, "Multiscale Procrustes-Based 3D Shape Control," is now available in IEEE/ASME Transactions on Mechatronics. Overview: Introducing a new 3D shape control method for handling large deformations in texture-less objects, using functional maps and a Procrustes-based multiscale strategy. 🌟 Key Features: - Effective with texture-less 3D objects and mult-robot setups - It uses an adaptive scale analysis, so it does not require a priori physical property information of the object. - Reliability: Stability analysis provided + robustness shown in experiments 🤝 Join the Discussion: Open invitation to explore our work and contribute ideas. Read the full publication [here](https://lnkd.in/dkSCTtde). #ShapeControl #Research #robotics #computervision #control #visualservoing 🎥 Watch the results video:
To view or add a comment, sign in
891 followers