Senior data engineer

Bangalore, India
Job Reference JR0074763
Professional Areas Digital Technology & Analytics
Function Information Technology
Years of Work Experience 5 - 8
Start date 2024-12-31

Louis Dreyfus Company is a leading merchant and processor of agricultural goods. Our activities span the entire value chain from farm to fork, across a broad range of business lines, we leverage our global reach and extensive asset network to serve our customers and consumers around the world. Structured as a matrix organization of six geographical regions and ten platforms, Louis Dreyfus Company is active in over 100 countries and employs approximately 17,000 people globally.

  • Ensure data availability, quality, and timeliness by designing performant pipelines and proactive monitoring. Ideate meaningful tests and monitoring to be proactively informed in case of data problems and to minimise regressions. 

  • Coordinate demands and source internal and external information across multiple business units to ensure we have the best possible understanding of vessels and their cargoes 

  • Act as data steward with researchers, traders and operations to help them leverage the best data sets for their use case and the most relevant best practices to ensure data is always available 

  • Retrieve, clean, model, transform and maintain data from many sources to better understand the factors influencing the tracking of commodities 

  • Troubleshoot and solve data issues 

  • Provide technical support and guidance to data scientists and researchers 

  • A Bachelor or Master in Computer Science, Business/Management Information Systems, Computer/Systems/Industrial Engineering, Business Analytics, Data Science, Operations Research or Statistics. Other backgrounds will be considered with relevant work experience. 
  •  

Additional Information for the job

  • 10+ years of experience in technical roles 
  • 7+ years' experience in data manipulation: DB design, data modelling, data transformation pipelines, ETL, data management 
  • 3+ years’ experience with a data-oriented programming language, preferably Python, including data manipulation and visualization packages (e.g., Pandas, Numpy, Plotly…) 
  • 2+ years’ experience with data visualisation tools and technologies like PowerBI, Tableau, Looker. Any experience in web development and Dash app creation is a distinctive advantage. 
  • Data mining principles: data collection, wrangling and quality checks using multiple data systems 
  • Experience working with cloud technologies like Azure, AWS or GCP 
  • Experience coaching junior profiles, establishing and evangelising best practices, and coordinating a small team of data engineers 
  • Experience with any of the following will be considered a plus:  
  • Performance optimisation for big, complex datasets (e.g. geospatial data), exposure to big data techniques like Spark  
  • Hands on experience with data storage solutions and their application: SQL, NoSQL, data lakes 
  • Agile development and DevOps tools: CI / CD pipelines, testing and monitoring best practices.  
  • Support for business-critical data transformation and applications via monitoring and alerting, and contributing to the solution of critical incidents under time pressure 

What Soft Skills will make you successful

  • Quick learner with the ability to work independently and with little prompting 
  • Excellent communication, collaboration and engagement skills 
  • Critical thinking, inclination to make improvements, find new ideas and challenge the status quo 
  • Flexibility and sense of adaptability in a quick paced, constantly evolving context 
  • Passionate about improving data literacy and spreading best practices 
  • Ability to perform under pressure, prioritize and escalate  
  • Strong problem solving, quantitative and analytical abilities  
  • Fluent in English  
  • Experience in the commodities sector is considered as a plus 

 

Diversity & Inclusion

LDC is driven by a set of shared values and high ethical standards, with diversity and inclusion being part of our DNA. LDC is an equal opportunity employer committed to providing a working environment that embraces and values diversity, equity and inclusion.

LDC encourages diversity, supports local communities and environmental initiatives. We encourage people of all backgrounds to apply.

Sustainability

Sustainable value is at the heart of our purpose as a company.

We are passionate about creating fair and sustainable value, both for our business and for other value chain stakeholders: our people, our business partners, the communities we touch and the environment around us

What We Offer

We provide a dynamic and stimulating international environment, which will stretch and develop your abilities and channel your skills and expertise with outstanding career development opportunities in one of the largest and most solid private companies in the world.

We offer

  • A workplace culture that embraces diversity and inclusivity
  • Opportunities for Professional Growth and Development
  • Employee Recognition Program
  • Employee Wellness Programs - Confidential access to certified counselors for employee and eligible family members, along with monthly wellness awareness sessions.
  • Certified Great Place to Work
Company Description

Louis Dreyfus Company is a leading merchant and processor of agricultural goods. Our activities span the entire value chain from farm to fork, across a broad range of business lines, we leverage our global reach and extensive asset network to serve our customers and consumers around the world. Structured as a matrix organization of six geographical regions and ten platforms, Louis Dreyfus Company is active in over 100 countries and employs approximately 17,000 people globally.


Job Description
  • Ensure data availability, quality, and timeliness by designing performant pipelines and proactive monitoring. Ideate meaningful tests and monitoring to be proactively informed in case of data problems and to minimise regressions. 

  • Coordinate demands and source internal and external information across multiple business units to ensure we have the best possible understanding of vessels and their cargoes 

  • Act as data steward with researchers, traders and operations to help them leverage the best data sets for their use case and the most relevant best practices to ensure data is always available 

  • Retrieve, clean, model, transform and maintain data from many sources to better understand the factors influencing the tracking of commodities 

  • Troubleshoot and solve data issues 

  • Provide technical support and guidance to data scientists and researchers 


Experience
  • A Bachelor or Master in Computer Science, Business/Management Information Systems, Computer/Systems/Industrial Engineering, Business Analytics, Data Science, Operations Research or Statistics. Other backgrounds will be considered with relevant work experience. 
  •  

Additional Information

Additional Information for the job

  • 10+ years of experience in technical roles 
  • 7+ years' experience in data manipulation: DB design, data modelling, data transformation pipelines, ETL, data management 
  • 3+ years’ experience with a data-oriented programming language, preferably Python, including data manipulation and visualization packages (e.g., Pandas, Numpy, Plotly…) 
  • 2+ years’ experience with data visualisation tools and technologies like PowerBI, Tableau, Looker. Any experience in web development and Dash app creation is a distinctive advantage. 
  • Data mining principles: data collection, wrangling and quality checks using multiple data systems 
  • Experience working with cloud technologies like Azure, AWS or GCP 
  • Experience coaching junior profiles, establishing and evangelising best practices, and coordinating a small team of data engineers 
  • Experience with any of the following will be considered a plus:  
  • Performance optimisation for big, complex datasets (e.g. geospatial data), exposure to big data techniques like Spark  
  • Hands on experience with data storage solutions and their application: SQL, NoSQL, data lakes 
  • Agile development and DevOps tools: CI / CD pipelines, testing and monitoring best practices.  
  • Support for business-critical data transformation and applications via monitoring and alerting, and contributing to the solution of critical incidents under time pressure 

What Soft Skills will make you successful

  • Quick learner with the ability to work independently and with little prompting 
  • Excellent communication, collaboration and engagement skills 
  • Critical thinking, inclination to make improvements, find new ideas and challenge the status quo 
  • Flexibility and sense of adaptability in a quick paced, constantly evolving context 
  • Passionate about improving data literacy and spreading best practices 
  • Ability to perform under pressure, prioritize and escalate  
  • Strong problem solving, quantitative and analytical abilities  
  • Fluent in English  
  • Experience in the commodities sector is considered as a plus 

 

Diversity & Inclusion

LDC is driven by a set of shared values and high ethical standards, with diversity and inclusion being part of our DNA. LDC is an equal opportunity employer committed to providing a working environment that embraces and values diversity, equity and inclusion.

LDC encourages diversity, supports local communities and environmental initiatives. We encourage people of all backgrounds to apply.

Sustainability

Sustainable value is at the heart of our purpose as a company.

We are passionate about creating fair and sustainable value, both for our business and for other value chain stakeholders: our people, our business partners, the communities we touch and the environment around us

What We Offer

We provide a dynamic and stimulating international environment, which will stretch and develop your abilities and channel your skills and expertise with outstanding career development opportunities in one of the largest and most solid private companies in the world.

We offer

  • A workplace culture that embraces diversity and inclusivity
  • Opportunities for Professional Growth and Development
  • Employee Recognition Program
  • Employee Wellness Programs - Confidential access to certified counselors for employee and eligible family members, along with monthly wellness awareness sessions.
  • Certified Great Place to Work