Data Engineer - Cloud Project
EyeTech Solutions
Bertrange, LU
il y a 2j
source : Monster
  • Has experience designing, building and operating data processing systems.
  • Cloud-based company.
  • Knows how to leverage machine learning solutions to provide more meaning and insights to our analytics.
  • Being able to structure them within data lakes and warehouses is.
  • Outstanding problem-solving skills and the ability to bring new ideas to improve existing processes.
  • You will work with a financial leader company.
  • Designing data processing systems :

  • data modeling / schema design
  • data publishing and visualization
  • batch and streaming data (Apache Beam, Spark, Hadoop, Kafka, )
  • job automation and orchestration (Apache Airflow, ...)
  • system availability and fault tolerance
  • architecture options ( message brokers, message queues, event processing, middleware, )
  • Building and operationalizing data processing systems :

  • storage and performance of retrieving data
  • lifecycle management of data
  • data cleansing
  • batch and streaming
  • transformation
  • provisioning, monitoring and adjusting pipelines
  • Ensuring solution quality :

  • data security (identity, access management, encryption, key management)
  • data privacy
  • scalability and efficiency
  • reliability and fidelity
  • flexibility and portability
  • Operationalizing machine learning models :

  • leverage pre-built ML models as a service
  • deploy an ML pipeline (ingesting data, retraining of ML models, )
  • measuring, monitoring and troubleshooting machine learning models
  • Experience with the Python programming language
  • Experience with designing, building and operating data -processing systems (Beam, Spark, Hadoop)
  • Experience with data modeling and common database systems (NoSQL document / entity, SQL)
  • Experience with analytics solutions (BigQuery, Apache Drill)
  • Experience with streaming / messaging platforms (Kafka, Pub / Sub, ...)
  • Experience with ETL solutions for both structured and unstructured data
  • Excellent oral and written communication skills in English
  • An exciting and dynamic work environment at the cutting-edge of its industry
  • An entrepreneurial spirit with the ability to make a direct and strong impact with new ideas
  • Flexibility and independence in work organization and schedule
  • Signaler cette offre d'emploi
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Postuler
    Mon email
    En cliquant sur « Continuer », je consens au traitement de mes données et à recevoir des alertes email, tel que détaillé dans la Politique de confidentialité de neuvoo. Je peux retirer mon consentement ou me désinscrire à tout moment.
    Continuer
    Formulaire de candidature