Salt Search
About Us
Job Responsibilities :
- Partner with business stakeholders to understand their needs and build impactful analytics solutions
- Design and build data pipelines to support data science projects following software engineering best practices
- Use state of the art technologies to acquire, ingest and transform big datasets
- Design and build Data / Analytics platform
- Map data fields to hypothesis, curate, wrangle and prepare data to be used in advanced analytics models
- Create and manage data environments in the cloud or on premise
Job Requirements :
- Degree educated in computer science, engineering, mathematics, or equivalent experience
- 7+ years of previous commercial experience as a leader in a data-driven role
- 3+ years of experience as a leader in Data / Analytics platform architecture design
- 3+ years of hands-on experience building data pipelines in production and ability to work across structured, semi-structured and unstructured data
- 3+ years of experience in ML pipeline for streaming / batch workflow
- Ability to write clean, maintainable, and robust code in Python, Scala, Java or similar languages
- Deep understanding and expertise of software engineering concepts and best practices
- Deep knowledge and expertise of testing frameworks and libraries Technical skills :
- Python
- Python
- Spark (PySpark)
- Pandas
- Jupyter
- SQL and No-SQL DBMS
- Git (as source code versioning and CI / CD)
- Exploratory Data Analysis (EDA)
- Imputation Techniques,
- Data Linking / Cleansing
- Feature Engineering
- Jenkins
- CI / CD
- Power BI (Optional)
New Jobs
Senior data engineer
Undefined
•
United arab emirates
•
15m ago
Lead data engineer
Undefined
•
United arab emirates
•
15m ago