/Student project: Instance Segmentation of Orchard Point Clouds using Deep Learning

Student project: Instance Segmentation of Orchard Point Clouds using Deep Learning

Research & development - Wageningen | More than two weeks ago

Implementing instance segmentation in point clouds for recognition of branch ages on apple trees to enhance orchard management practices.

Student project: Instance Segmentation of Orchard Point Clouds using Deep Learning 

What you will do

Digital Orchard Program: Implementing a Digital Twin of an Orchard 

In our Digital Orchard program, we aim to create a digital twin of an orchard by combining LiDAR and common (RGB) cameras data into a “colored point cloud”. The goal is to use existing data and run new measurement campaigns allowing us to follow fruit tree development in the orchard over time. The ultimate objective is to perform instance segmentation on the tree point cloud for recognition of age of branches on apple trees in the orchard, which can be a vital step in Orchard Management around tree monitoring for the future. However, depending on the complexity instance segmentation of the trees can be a first step. 

Literature Review of Related Solution and Technology 
The first task is to conduct a literature review of related solutions and technologies. This will involve researching existing digital twin implementations, point cloud processing techniques, and deep learning algorithms for instance segmentation. The literature review will help us to identify the best practices and state-of-the-art techniques for implementing our digital twin. 

Plan Containing a Timeline with Deliverables 
The second task is to prepare a plan containing a timeline with deliverables. This plan will outline the milestones and deadlines for the project, including the literature review, measurement campaigns, point cloud processing, deep learning algorithm development, and evaluation. The plan will help us stay on track and ensure that we meet our objectives on time. 

Actively Participate in and Plan Measurement Campaigns 
The third task is to actively participate and plan measurement campaigns. This will involve coordinating with the team to schedule measurement campaigns, setting up recording devices, and ensuring that the data is collected accurately. The measurement campaigns will provide us with the data we need to create the digital twin and train the deep learning algorithm. 

Process and Annotate Point Clouds (Using Change Detection) Making Them Suitable for Deep Learning 
The fourth task is to process and annotate (colored) point clouds using change detection, making them suitable for deep learning. This will involve developing algorithms to process the point cloud data, segment the trees, and annotate the data for training the deep learning algorithm. Change detection between multiple years of data will allow us to retrieve annotation without performing much manual annotation. 

Create a Deep Learning Point Cloud Algorithm and Evaluate the Deep Learning Solution 
The fifth and final task is to create a deep learning point cloud algorithm and evaluate the deep learning solution. This will involve developing a deep learning algorithm for instance segmentation, training the algorithm on the annotated data, and evaluating the performance of the algorithm. The evaluation will help us determine the accuracy and effectiveness of the algorithm and identify areas for improvement. 

What we do for you

  • We have a challenging problem where you have a lot of freedom to come up with solutions. 
  • We have a diverse team of experts both from the biological and the technical sides to supervise and support you. 
  • You will join the Data Science team of OnePlanet, which employs state of the art knowledge on machine learning for precision agriculture and the frameworks necessary to perform these big data tasks at huge scale. 
  • You will be able to exchange views and knowledge with the OnePlanet and Imec community of experts and scientists, widening your professional network. 
  • We can help you to improve your coding skills up to industry standards. 
  • You have access to our cloud solutions to solve this problem allowing you to process large amount of data within reasonable time. 

Who you are

  • Familiarity with LiDAR scanning & point clouds.
  • You are available for at least 6 months.
  • Knowledge of Python. 
  • Knowledge of Machine Learning. 
  • Knowledge of OpenCV, Open3D is a plus.
  • Experience with PyTorch or TensorFlow is a plus. 
  • Knowledge of Git. 
  • Basic understanding of Agile-Scrum. 
  • You are passionate about bringing positive impact to environmental and societal challenges. 
  • You are entitled to do an internship in the Netherlands.
  • You are a self-starter and able to work independently.
  • Good written and verbal English skills.


Does this project sound like an interesting next step in your career at imec? Don’t hesitate to submit your application by clicking on ‘APPLY NOW’.
Should you have more questions about the project and the recruitment process, you can contact Martijn Kohl. He will be happy to assist you.

Who we are
Accepteer marketing-cookies om deze content te kunnen bekijken.
imec's cleanroom
Accepteer marketing-cookies om deze content te kunnen bekijken.

Verzend deze job naar jouw e-mailadres