Has experience designing, building and operating data processing systems.
Knows how to leverage machine learning solutions to provide more meaning and insights to our analytics.
Being able to structure them within data lakes and warehouses is.
Outstanding problem-solving skills and the ability to bring new ideas to improve existing processes.
You will work with a financial leader company.
Designing data processing systems :
data modeling / schema design
data publishing and visualization
batch and streaming data (Apache Beam, Spark, Hadoop, Kafka, )
job automation and orchestration (Apache Airflow, ...)
system availability and fault tolerance
architecture options ( message brokers, message queues, event processing, middleware, )
Building and operationalizing data processing systems :
storage and performance of retrieving data
lifecycle management of data
batch and streaming
provisioning, monitoring and adjusting pipelines
Ensuring solution quality :
data security (identity, access management, encryption, key management)
scalability and efficiency
reliability and fidelity
flexibility and portability
Operationalizing machine learning models :
leverage pre-built ML models as a service
deploy an ML pipeline (ingesting data, retraining of ML models, )
measuring, monitoring and troubleshooting machine learning models
Experience with the Python programming language
Experience with designing, building and operating data -processing systems (Beam, Spark, Hadoop)
Experience with data modeling and common database systems (NoSQL document / entity, SQL)
Experience with analytics solutions (BigQuery, Apache Drill)
Experience with streaming / messaging platforms (Kafka, Pub / Sub, ...)
Experience with ETL solutions for both structured and unstructured data
Excellent oral and written communication skills in English
An exciting and dynamic work environment at the cutting-edge of its industry
An entrepreneurial spirit with the ability to make a direct and strong impact with new ideas
Flexibility and independence in work organization and schedule