Data Engineer
Company Description
Company Description |
LDC is seeking a skilled Data Engineer to join our dynamic Global Data Science team at LDC. In this critical role, you will leverage your expertise in Python programming, ETL processes, and cloud-based DevOps to enhance our data infrastructure and software development practices used for Remote sensing data analysis. Your contributions will be key in supporting our data science activities, and overall, our data-driven decision-making processes. Your work will be instrumental in empowering our trading platforms with robust data solutions. You will also face the exciting challenge of structuring complex and large satellite time series data, particularly in the realm of crop monitoring, ensuring our traders are informed by accurate, high-quality and near-real-time data.
Job Description
Job Description |
Main responsibilities:
- Develop, maintain, and optimize ETL pipelines, specifically tailored to meet the data requirements of our systematic trading activities, with a focus on building robust data solutions that empower profitable trading algorithms.
- Design and implement robust software solutions in Python, focusing on scalability, performance, and reliability.
- Schedule and automate workflows, enhancing operational efficiency and accuracy.
- Collaborate in the development and maintenance of cloud-based infrastructure, applying best practices in DevOps to ensure high data availability and scalability.
- Work closely with data scientists, quantitative researchers, and trading teams to understand their data needs, providing technical solutions that enable effective data analysis and strategy implementation.
- Ensure code quality and maintainability by implementing strong CI/CD practices, code versioning, automated tests, and conducting thorough peer-reviews.
- Stay current with emerging trends and advancements in software development, data engineering, and cloud technologies, integrating new tools and techniques where beneficial.
- Expertise in handling and optimizing relational databases to support analytical applications
Other Skills & competencies /Specific knowledge/ Abilities:
- BSc or MSc in Computer Science, Engineering, Information Systems, or a related field.
- Proficiency in Python programming and experience with software development best practices.
- knowledge of ETL processes and familiarity with data modeling and warehousing.
- Experience with Jenkins or similar scheduling tools, and strong understanding of CI/CD principles.
- Hands-on experience with cloud technologies and services, preferably in Azure.
- Strong problem-solver, attention to detail, and ability to work independently and collaboratively.
- Fluent in English
Experience
Experience |
Minimum years of experience & CTC :
- 5 years experience of with right skillset.
Reporting Line: Will be Reporting to the D&A Data Engineering Team
- Education: Graduation in computering engineering and Equivalent .
Languages skills: Oral and Written Fluency in English is a must.
Additional Information
Additional Information |
Additional Information for the job
Diversity & Inclusion
LDC is driven by a set of shared values and high ethical standards, with diversity and inclusion being part of our DNA. LDC is an equal opportunity employer committed to providing a working environment that embraces and values diversity, equity and inclusion.
LDC encourages diversity, supports local communities and environmental initiatives. We encourage people of all backgrounds to apply.
Sustainability
Sustainable value is at the heart of our purpose as a company.
We are passionate about creating fair and sustainable value, both for our business and for other value chain stakeholders: our people, our business partners, the communities we touch and the environment around us
What We Offer
We provide a dynamic and stimulating international environment, which will stretch and develop your abilities and channel your skills and expertise with outstanding career development opportunities in one of the largest and most solid private companies in the world.
We offer
- A workplace culture that embraces diversity and inclusivity
- Opportunities for Professional Growth and Development
- Employee Recognition Program
- Employee Wellness Programs - Confidential access to certified counselors for employee and eligible family members, along with monthly wellness awareness sessions.
- Certified Great Place to Work
LDC is seeking a skilled Data Engineer to join our dynamic Global Data Science team at LDC. In this critical role, you will leverage your expertise in Python programming, ETL processes, and cloud-based DevOps to enhance our data infrastructure and software development practices used for Remote sensing data analysis. Your contributions will be key in supporting our data science activities, and overall, our data-driven decision-making processes. Your work will be instrumental in empowering our trading platforms with robust data solutions. You will also face the exciting challenge of structuring complex and large satellite time series data, particularly in the realm of crop monitoring, ensuring our traders are informed by accurate, high-quality and near-real-time data.
Main responsibilities:
- Develop, maintain, and optimize ETL pipelines, specifically tailored to meet the data requirements of our systematic trading activities, with a focus on building robust data solutions that empower profitable trading algorithms.
- Design and implement robust software solutions in Python, focusing on scalability, performance, and reliability.
- Schedule and automate workflows, enhancing operational efficiency and accuracy.
- Collaborate in the development and maintenance of cloud-based infrastructure, applying best practices in DevOps to ensure high data availability and scalability.
- Work closely with data scientists, quantitative researchers, and trading teams to understand their data needs, providing technical solutions that enable effective data analysis and strategy implementation.
- Ensure code quality and maintainability by implementing strong CI/CD practices, code versioning, automated tests, and conducting thorough peer-reviews.
- Stay current with emerging trends and advancements in software development, data engineering, and cloud technologies, integrating new tools and techniques where beneficial.
- Expertise in handling and optimizing relational databases to support analytical applications
Other Skills & competencies /Specific knowledge/ Abilities:
- BSc or MSc in Computer Science, Engineering, Information Systems, or a related field.
- Proficiency in Python programming and experience with software development best practices.
- knowledge of ETL processes and familiarity with data modeling and warehousing.
- Experience with Jenkins or similar scheduling tools, and strong understanding of CI/CD principles.
- Hands-on experience with cloud technologies and services, preferably in Azure.
- Strong problem-solver, attention to detail, and ability to work independently and collaboratively.
- Fluent in English
Minimum years of experience & CTC :
- 5 years experience of with right skillset.
Reporting Line: Will be Reporting to the D&A Data Engineering Team
- Education: Graduation in computering engineering and Equivalent .
Languages skills: Oral and Written Fluency in English is a must.
Additional Information for the job
Diversity & Inclusion
LDC is driven by a set of shared values and high ethical standards, with diversity and inclusion being part of our DNA. LDC is an equal opportunity employer committed to providing a working environment that embraces and values diversity, equity and inclusion.
LDC encourages diversity, supports local communities and environmental initiatives. We encourage people of all backgrounds to apply.
Sustainability
Sustainable value is at the heart of our purpose as a company.
We are passionate about creating fair and sustainable value, both for our business and for other value chain stakeholders: our people, our business partners, the communities we touch and the environment around us
What We Offer
We provide a dynamic and stimulating international environment, which will stretch and develop your abilities and channel your skills and expertise with outstanding career development opportunities in one of the largest and most solid private companies in the world.
We offer
- A workplace culture that embraces diversity and inclusivity
- Opportunities for Professional Growth and Development
- Employee Recognition Program
- Employee Wellness Programs - Confidential access to certified counselors for employee and eligible family members, along with monthly wellness awareness sessions.
- Certified Great Place to Work