Oracle + PySpark Data Engineer (Remote)

Join Our Team: Oracle + PySpark Data Engineer (Remote) at PradeepIT Consulting Services Pvt Ltd

Job Description:

We are currently looking for an experienced Oracle + PySpark Data Engineer/Analyst with 5 to 7 years of professional experience. As a crucial part of our data team, you will use your skills to manage, transform, and analyze large data sets to drive sophisticated decision-making processes. This is a fantastic opportunity for professionals who are adept at maintaining data integrity, optimizing data flows, and scaffolding data-driven frameworks.

Key Responsibilities:

• Data Integration: Execute integration of various data sources into Oracle databases and construct efficient PySpark data pipelines for analytics and transformation.
• Data Transformation: Develop, implement and maintain dynamic PySpark workflows to cleanse, enrich, and organize data suited for analytical studies.
• Data Modeling: Build and continually enhance data models within Oracle to ensure optimal structuring and indexing for superior query performance.
• Query Optimization: Craft intricate SQL queries and PySpark scripts tailored for brisk data retrieval and streamlined processing.
• Data Analysis: Work closely with data analysts and business units to distill insights through robust data analytics and comprehensive reporting.
• Data Quality: Champion the implementation of stringent quality controls, error management, and validation protocols to guarantee the reliability and accuracy of data.
• Performance Tuning: Fine-tune both Oracle setups and PySpark jobs to elevate processing efficiency and overall performance.

Technical Skills Required:

• Proven expertise in Oracle databases and PySpark applications.
• Strong command of SQL, PL/SQL, Python, and PySpark.
• Adept in Oracle database management, data warehousing, and ETL processes.
• Well-versed in big data technologies and principles of distributed computing.
• Excellent analytical, troubleshooting, and problem-solving skills.
• Effective communication and robust teamwork capabilities.
• In-depth knowledge of data security norms and compliance benchmarks.

Documentation: Develop and maintain detailed documentation covering data models, ETL mechanisms, and all codebases.

About PradeepIT Consulting Services Pvt Ltd: devast>This role offers a remote working option, allowing you to join our dynamic team from anywhere. At PradeepIT, we empower our employees to innovate and develop solutions that truly make a difference.

If you are eager to contribute to data-driven projects and possess the required skill set, apply today to become part of a visionary data engineering team at PradeepIT Consulting Services Pvt Ltd.