Data Engineer, Azure Based US Energy Markets

  • Full Time
Job expired!
ICF (NASDAQ: ICFI) is a worldwide consulting services company boasting over 9,000 full-time and part-time employees. However, we are not your average consultants. At ICF, we pride ourselves in fostering strategic partnerships between our business analysts, policy specialists, digital strategists, data scientists, and creatives. Leveraging our robust industry expertise and the latest engagement tools, we aim to assist organizations in overcoming their most intricate challenges. Ever since our inception in 1969, we have collaborated with both public and private sector clients to embrace change and shape a better future. For more information, visit our website at icf.com. We are currently seeking a Data Engineer to bolster ICF's commitment to creating innovative, accurate, timely, and high-quality products and services. Typically involved in multiple projects concurrently, you will have the chance to utilize your academic knowledge, gain firsthand exposure to major projects, and interact with industry leaders and clients. This experience promises to elevate your content knowledge and consulting skills. The title of the position is Data Engineer for US Power Markets. The job is located in New Delhi, and we are looking for applicants with 1-2 years of experience. The responsibilities of the position include: 1. Data Acquisition and Processing: Extracting, transforming, loading (ETL) data from sources like ISOs and public regulatory agencies; developing and maintaining web scrapers for real-time power market analytics; implementing RESTful services to fetch data and handle asynchronous tasks efficiently. 2. Data Warehousing and Optimization: Designing and managing data warehouse solutions via Azure Data Lake, and streamlining data processes for fast and reliable access to clean and accurate data. 3. Cloud-Based ETL Development: Designing, building, and optimizing ETL jobs using Azure services, and integrating with various Azure services to improve the scalability and resilience of the data pipeline. 4. Collaboration and Communication: Working closely with data SMEs, analysts, and stakeholders to ensure data availability and accuracy; providing documentation and sharing information on developed pipelines with the team. 5. Continuous Improvement: Staying up-to-date with the latest developments in Azure services and the power markets domain; proactively identifying opportunities for process improvements and adopting best practices. Candidates should have: a bachelor's degree in Computer Science, Data Science, Operations Research, Engineering or a related field; familiarity with Power markets and Energy policy; proven experience with web scraping, data warehousing, and streamlining data; hands-on experience with RESTful service development and asynchronous functions; Prior experience in building and optimizing ETL jobs on cloud platforms. Preferred qualifications are: extensive experience with Azure services such as AKS, Azure Batch, Azure Data Factory, Azure Data Lake, Azure Functions, and Azure Blob Storage; a strong understanding of distributed systems and cloud-based architectures; knowledge and experience with Operations Research techniques like Linear Programming, Integer Programming, Nonlinear Programming, and other optimization models; familiarity with tools like CPLEX, Gurobi, or similar optimization solvers is a plus; demonstrated ability to apply OR techniques to real-world problems; excellent problem-solving skills, coupled with the capacity to perform in fast-paced environments. Working at ICF means being part of a global advisory and digital services provider that brings unparalleled expertise and advanced technology to help clients navigate complex challenges, adapt to change, and envision a brighter future. The position is based in New Delhi, India (II77).