Data Engineer (GIS & RS)
Company Description
Company Description |
Job Description
Job Description |
Job Description
LDC is looking for a Data Engineer to join the Global Digital Transformation and Analytics (DT & A) team of data engineering experts, supporting innovative solutions whose impact is transforming our business.
We are seeking a highly skilled and motivated Data Engineer to join our team and take responsibility for organizing and managing our Remote Sensing data. As a Data Engineer, you will play a crucial role in planning the data architecture, designing, and maintaining our database infrastructure, ensuring efficient and scalable data management practices. Additionally, you will be involved in API integration and providing data support for front-end development to enable seamless data access and visualization.
Duties & Responsibilities:
- Designing the architecture for organising different remote sensing / geospatial datasets while ensuring optimal performance, scalability, and reliability.
- Retrieve, clean, model, transform and maintain data from various sources for downstream use cases
- Ensure data availability, quality, and timeliness by designing performant pipelines and proactive monitoring. Ideate meaningful tests and monitoring to be proactively informed in case of data problems and to minimise regressions.
- Provisioning APIs for consuming the data by end customers and downstream applications
- Collaborate with front-end developers to provide data for visualisations and reporting ensuring optimal performance and scalability
Act as data steward with data analysts, data scientists and traders to help them leverage the best data sets for their use case and follow relevant best practices to ensure data is always available
l
Experience
Experience |
- 5 years of experience in technical roles
- 3 years of experience handling data: DB design, data modelling, data collection, data transformation pipelines, ETL, data management, quality checks using both on premises and cloud systems
- Strong proficiency in SQL. Database or other types of data storage design. Performance optimisation for big, complex data sets. Hands on experience with data storage solutions and their application (SQL, NoSQL, data lakes).
- 3 years’ experience with a data-oriented programming language, preferably Python, including data manipulation and visualization packages (e.g., Pandas, Numpy, Plotly…)
- Experience with API integration
- 2 years’ experience with data visualisation tools and technologies like PowerBI, Tableau, Looker. Any experience in web development and Dash app creation is a distinctive advantage.
- Experience working with cloud technologies like Azure or GCP
- Experience with collaborative software development best practices: source control strategies (git), peer reviews
- Experience with any of the following will be considered a plus:
- handling big datasets (e.g., geospatial data), exposure to big data techniques like Spark
- Agile development and DevOps tools: CI / CD pipelines, testing and monitoring best practices.
- Support for business-critical data transformation and applications via monitoring and alerting, and contributing to the solution of critical incidents under time pressure .
Education:
- A Bachelor or master's in computer science, Business/Management Information Systems, Computer/Systems/Industrial Engineering, Business Analytics, Data Science, Operations Research or Statistics. Other backgrounds will be considered with relevant work experience.
Additional Information
Additional Information |
What Soft Skills will make you successful:
- Quick learner with the ability to work independently and with little prompting
- Excellent communication, collaboration, and engagement skills
- Critical thinking, inclination to make improvements, find innovative ideas and challenge the status quo
- Flexibility and sense of adaptability in a quick paced, constantly evolving context
- Passionate about improving data literacy and spreading best practices
- Ability to perform under pressure, prioritize and escalate
- Strong problem solving, quantitative and analytical abilities
- Fluent in English
- Experience in the commodities sector is considered as a plus
What We Offer
We provide a dynamic and stimulating international environment, which will stretch and develop your abilities and channel your skills and expertise with outstanding career development opportunities in one of the largest and most solid private companies in the world.
We offer
- Competitive salary and benefits
- Hybrid work available (not applicable to all roles)
- Pension contributions
- Access to Training and Development
- Access to Concierge Partnerships
Diversity & Inclusion
LDC is driven by a set of shared values and high ethical standards, with diversity and inclusion being part of our DNA. LDC is an equal opportunity employer committed to providing a working environment that embraces and values diversity, equity and inclusion.
LDC encourages diversity, supports local communities and environmental initiatives. We encourage people of all backgrounds to apply.
Sustainability
Sustainable value is at the heart of our purpose as a company.
We are passionate about creating fair and sustainable value, both for our business and for other value chain stakeholders: our people, our business partners, the communities we touch and the environment around us
Job Description
LDC is looking for a Data Engineer to join the Global Digital Transformation and Analytics (DT & A) team of data engineering experts, supporting innovative solutions whose impact is transforming our business.
We are seeking a highly skilled and motivated Data Engineer to join our team and take responsibility for organizing and managing our Remote Sensing data. As a Data Engineer, you will play a crucial role in planning the data architecture, designing, and maintaining our database infrastructure, ensuring efficient and scalable data management practices. Additionally, you will be involved in API integration and providing data support for front-end development to enable seamless data access and visualization.
Duties & Responsibilities:
- Designing the architecture for organising different remote sensing / geospatial datasets while ensuring optimal performance, scalability, and reliability.
- Retrieve, clean, model, transform and maintain data from various sources for downstream use cases
- Ensure data availability, quality, and timeliness by designing performant pipelines and proactive monitoring. Ideate meaningful tests and monitoring to be proactively informed in case of data problems and to minimise regressions.
- Provisioning APIs for consuming the data by end customers and downstream applications
- Collaborate with front-end developers to provide data for visualisations and reporting ensuring optimal performance and scalability
Act as data steward with data analysts, data scientists and traders to help them leverage the best data sets for their use case and follow relevant best practices to ensure data is always available
l
- 5 years of experience in technical roles
- 3 years of experience handling data: DB design, data modelling, data collection, data transformation pipelines, ETL, data management, quality checks using both on premises and cloud systems
- Strong proficiency in SQL. Database or other types of data storage design. Performance optimisation for big, complex data sets. Hands on experience with data storage solutions and their application (SQL, NoSQL, data lakes).
- 3 years’ experience with a data-oriented programming language, preferably Python, including data manipulation and visualization packages (e.g., Pandas, Numpy, Plotly…)
- Experience with API integration
- 2 years’ experience with data visualisation tools and technologies like PowerBI, Tableau, Looker. Any experience in web development and Dash app creation is a distinctive advantage.
- Experience working with cloud technologies like Azure or GCP
- Experience with collaborative software development best practices: source control strategies (git), peer reviews
- Experience with any of the following will be considered a plus:
- handling big datasets (e.g., geospatial data), exposure to big data techniques like Spark
- Agile development and DevOps tools: CI / CD pipelines, testing and monitoring best practices.
- Support for business-critical data transformation and applications via monitoring and alerting, and contributing to the solution of critical incidents under time pressure .
Education:
- A Bachelor or master's in computer science, Business/Management Information Systems, Computer/Systems/Industrial Engineering, Business Analytics, Data Science, Operations Research or Statistics. Other backgrounds will be considered with relevant work experience.
What Soft Skills will make you successful:
- Quick learner with the ability to work independently and with little prompting
- Excellent communication, collaboration, and engagement skills
- Critical thinking, inclination to make improvements, find innovative ideas and challenge the status quo
- Flexibility and sense of adaptability in a quick paced, constantly evolving context
- Passionate about improving data literacy and spreading best practices
- Ability to perform under pressure, prioritize and escalate
- Strong problem solving, quantitative and analytical abilities
- Fluent in English
- Experience in the commodities sector is considered as a plus
What We Offer
We provide a dynamic and stimulating international environment, which will stretch and develop your abilities and channel your skills and expertise with outstanding career development opportunities in one of the largest and most solid private companies in the world.
We offer
- Competitive salary and benefits
- Hybrid work available (not applicable to all roles)
- Pension contributions
- Access to Training and Development
- Access to Concierge Partnerships
Diversity & Inclusion
LDC is driven by a set of shared values and high ethical standards, with diversity and inclusion being part of our DNA. LDC is an equal opportunity employer committed to providing a working environment that embraces and values diversity, equity and inclusion.
LDC encourages diversity, supports local communities and environmental initiatives. We encourage people of all backgrounds to apply.
Sustainability
Sustainable value is at the heart of our purpose as a company.
We are passionate about creating fair and sustainable value, both for our business and for other value chain stakeholders: our people, our business partners, the communities we touch and the environment around us