Data Engineer
Company Description
Company Description |
Job Description
Job Description |
LDC is looking for a Data Engineer to join the Global Digital Transformation and Analytics (DT & A) team of data engineering experts, supporting innovative solutions whose impact is transforming our business.
As a data engineer, you will provide the data to enable faster, better, data-informed decision-making within the business.
You will work with a vast array of big and small datasets, from weather forecasts to satellite images, from macroeconomic news feed to market data, from public data to highly sensitive, proprietary information. You closely collaborate with the Coffee platform’s data scientists and fundamental analysts, supporting the trading activities with high quality information, making sure the right data is consistently available at the right time, implementing data and analytics best practices and contributing to their definition as our needs evolve. You strive for excellence in the technological setup to provide automated, high-quality, real-time indicators, so that data analysts and data scientists can answer business questions directly with confidence.
Duties & Responsibilities:
- Ensure data availability, quality, and timeliness by designing performant pipelines and proactive monitoring. Ideate meaningful tests and monitoring to be proactively informed in case of data problems and to minimise regressions.
- Improve data availability in the Coffee platform by creating data transformations, enrichments and compelling visualisations in collaboration with data scientists and experts
- Act as data steward with researchers, traders and operations to help them leverage the best data sets for their use case and the most relevant best practices to ensure data is always available
- Retrieve, clean, model, transform and maintain data from many sources to better understand the factors influencing Coffee trading
- Troubleshoot and solve data issues
- Provide technical support and guidance to Coffee data scientists and researchers
What Hard Skills will make you successful:
- 5 years of experience in technical roles
- 3 years' experience in data manipulation: DB design, data modelling, data transformation pipelines, ETL, data management
- 3 years’ experience with a data-oriented programming language, preferably Python, including data manipulation and visualization packages (e.g., Pandas, Numpy, Plotly…)
- 2 years’ experience with data visualisation tools and technologies like PowerBI, Tableau, Looker. Any experience in web development and Dash app creation is a distinctive advantage.
- Strong proficiency in SQL. Database or other types of data storage design. Performance optimisation for big, complex data sets. Hands on experience with data storage solutions and their application (SQL, NoSQL, data lakes).
- Data mining principles: data collection, wrangling and quality checks using multiple data systems, both on premises and cloud-based
- Experience working with cloud technologies like Azure or GCP
- Experience with collaborative software development best practices: source control strategies (git), peer reviews
- Experience with any of the following will be considered a plus:
- handling big datasets (e.g. geospatial data), exposure to big data techniques like Spark
- Agile development and DevOps tools: CI / CD pipelines, testing and monitoring best practices.
- Support for business-critical data transformation and applications via monitoring and alerting, and contributing to the solution of critical incidents under time pressure
Experience
Experience |
Education:
- A Bachelor or Master in Computer Science, Business/Management Information Systems, Computer/Systems/Industrial Engineering, Business Analytics, Data Science, Operations Research or Statistics. Other backgrounds will be considered with relevant work experience.
Required Languages
Required Languages |
Additional Information
Additional Information |
What Soft Skills will make you successful:
- Quick learner with the ability to work independently and with little prompting
- Excellent communication, collaboration and engagement skills
- Critical thinking, inclination to make improvements, find new ideas and challenge the status quo
- Flexibility and sense of adaptability in a quick paced, constantly evolving context
- Passionate about improving data literacy and spreading best practices
- Ability to perform under pressure, prioritize and escalate
- Strong problem solving, quantitative and analytical abilities
- Fluent in English
- Experience in the commodities sector is considered as a plus
What We Offer
We provide a dynamic and stimulating international environment, which will stretch and develop your abilities and channel your skills and expertise with outstanding career development opportunities in one of the largest and most solid private companies in the world.
We offer
- Competitive salary and benefits
- Hybrid work available (not applicable to all roles)
- Pension contributions
- Access to Training and Development
- Access to Concierge Partnerships
Diversity & Inclusion
LDC is driven by a set of shared values and high ethical standards, with diversity and inclusion being part of our DNA. LDC is an equal opportunity employer committed to providing a working environment that embraces and values diversity, equity and inclusion.
LDC encourages diversity, supports local communities and environmental initiatives. We encourage people of all backgrounds to apply.
Sustainability
Sustainable value is at the heart of our purpose as a company.
We are passionate about creating fair and sustainable value, both for our business and for other value chain stakeholders: our people, our business partners, the communities we touch and the environment around us
LDC is looking for a Data Engineer to join the Global Digital Transformation and Analytics (DT & A) team of data engineering experts, supporting innovative solutions whose impact is transforming our business.
As a data engineer, you will provide the data to enable faster, better, data-informed decision-making within the business.
You will work with a vast array of big and small datasets, from weather forecasts to satellite images, from macroeconomic news feed to market data, from public data to highly sensitive, proprietary information. You closely collaborate with the Coffee platform’s data scientists and fundamental analysts, supporting the trading activities with high quality information, making sure the right data is consistently available at the right time, implementing data and analytics best practices and contributing to their definition as our needs evolve. You strive for excellence in the technological setup to provide automated, high-quality, real-time indicators, so that data analysts and data scientists can answer business questions directly with confidence.
Duties & Responsibilities:
- Ensure data availability, quality, and timeliness by designing performant pipelines and proactive monitoring. Ideate meaningful tests and monitoring to be proactively informed in case of data problems and to minimise regressions.
- Improve data availability in the Coffee platform by creating data transformations, enrichments and compelling visualisations in collaboration with data scientists and experts
- Act as data steward with researchers, traders and operations to help them leverage the best data sets for their use case and the most relevant best practices to ensure data is always available
- Retrieve, clean, model, transform and maintain data from many sources to better understand the factors influencing Coffee trading
- Troubleshoot and solve data issues
- Provide technical support and guidance to Coffee data scientists and researchers
What Hard Skills will make you successful:
- 5 years of experience in technical roles
- 3 years' experience in data manipulation: DB design, data modelling, data transformation pipelines, ETL, data management
- 3 years’ experience with a data-oriented programming language, preferably Python, including data manipulation and visualization packages (e.g., Pandas, Numpy, Plotly…)
- 2 years’ experience with data visualisation tools and technologies like PowerBI, Tableau, Looker. Any experience in web development and Dash app creation is a distinctive advantage.
- Strong proficiency in SQL. Database or other types of data storage design. Performance optimisation for big, complex data sets. Hands on experience with data storage solutions and their application (SQL, NoSQL, data lakes).
- Data mining principles: data collection, wrangling and quality checks using multiple data systems, both on premises and cloud-based
- Experience working with cloud technologies like Azure or GCP
- Experience with collaborative software development best practices: source control strategies (git), peer reviews
- Experience with any of the following will be considered a plus:
- handling big datasets (e.g. geospatial data), exposure to big data techniques like Spark
- Agile development and DevOps tools: CI / CD pipelines, testing and monitoring best practices.
- Support for business-critical data transformation and applications via monitoring and alerting, and contributing to the solution of critical incidents under time pressure
Education:
- A Bachelor or Master in Computer Science, Business/Management Information Systems, Computer/Systems/Industrial Engineering, Business Analytics, Data Science, Operations Research or Statistics. Other backgrounds will be considered with relevant work experience.
What Soft Skills will make you successful:
- Quick learner with the ability to work independently and with little prompting
- Excellent communication, collaboration and engagement skills
- Critical thinking, inclination to make improvements, find new ideas and challenge the status quo
- Flexibility and sense of adaptability in a quick paced, constantly evolving context
- Passionate about improving data literacy and spreading best practices
- Ability to perform under pressure, prioritize and escalate
- Strong problem solving, quantitative and analytical abilities
- Fluent in English
- Experience in the commodities sector is considered as a plus
What We Offer
We provide a dynamic and stimulating international environment, which will stretch and develop your abilities and channel your skills and expertise with outstanding career development opportunities in one of the largest and most solid private companies in the world.
We offer
- Competitive salary and benefits
- Hybrid work available (not applicable to all roles)
- Pension contributions
- Access to Training and Development
- Access to Concierge Partnerships
Diversity & Inclusion
LDC is driven by a set of shared values and high ethical standards, with diversity and inclusion being part of our DNA. LDC is an equal opportunity employer committed to providing a working environment that embraces and values diversity, equity and inclusion.
LDC encourages diversity, supports local communities and environmental initiatives. We encourage people of all backgrounds to apply.
Sustainability
Sustainable value is at the heart of our purpose as a company.
We are passionate about creating fair and sustainable value, both for our business and for other value chain stakeholders: our people, our business partners, the communities we touch and the environment around us