Join Our Team as a Senior Data Engineer - Acquisition & Infrastructure at Eon Systems

We're looking for a skilled Senior Data Engineer to join Eon Systems, a pioneering company at the intersection of neuroscience and artificial intelligence. This position focuses on the acquisition, handling, and processing of complex neuroscientific data, playing a crucial role in shaping our machine learning capabilities.

The Role

As a key member of our dedicated team, you will:

• Build, maintain, and optimize cloud-based data pipelines from data capture to processing, ensuring they serve the needs of our machine learning models.
• Manage the acquisition of petabytes of diverse and multimodal online datasets.
• Assess, clean, and organize unstructured and noisy datasets to prepare them for analytical applications.
• Work closely with ML engineers to develop APIs for feeding processed brain data into training environments.
• Enhance data pipeline functionality, scalability, and accessibility across the board.
• Collaborate with both human and animal brain data acquisition teams and AI engineering groups to bridge the gap between data collection and model application.
• Design and create validation and quality assurance processes to maintain high data standards.

Key Projects

During your tenure, you will engage in projects such as:

• Downloading and preprocessing neuro datasets from over 10 repositories and ensuring their integration into our training pipelines.
• Crafting an innovative validation system to automatically evaluate and enhance dataset quality based on specific metrics.
• Extracting and harmonizing metadata from various sources to enrich the datasets further.
• Visualizing key performance indicators to assess and improve the effectiveness of the data processed.

Requirements

The ideal candidate for this position should exhibit:

• Proven experience in managing, preprocessing, and organizing large, messy, unstructured datasets, preferably within a scientific research context.
• Expertise in developing and maintaining cloud-based data pipelines, ideally with knowledge of AWS and other cloud platforms.
• Strong familiarity with machine learning frameworks and the implications of data preprocessing on model performance.
• Capable of implementing effective data validation and cleansing procedures.
• Excellent project management skills and commitment to delivering technical solutions on schedule.
• Effective communication abilities for interacting with both technical and non-technical teams.

Preferred Qualifications

Candidates with experience in Kafka, Hadoop, EMR, GCP, Spark, or database management will be given priority consideration. Knowledge in ETL processes, SQL/NoSQL databases, and familiarity with data-centric policy and technology trends are also highly desired.

Compensation

Eon Systems offers competitive salaries and equity packages tailored to attract and retain top talent in our field.

If you are ready to contribute to cutting-edge AI projects and work at the forefront of technological advancements in neuroscience, apply today to become part of Eon Systems.