"Search to AWS. This involves moving the Elasticsearch and ingestion webservice to AWS. AWS knowledge is preferred. 5+ years AB Initio recent experience Experience of AWS migrations. Must be independent and self starting Must have good spoken & written English Jira experience."

We value the following skills

• Data engineer with hands on experience working on Big Data Platforms
• Experience building and optimizing Big data data pipelines and data sets ranging from Data ingestion to Processing to Data Visualization.
•  Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and steaming data processing
• Good experience in any one programming language -Scala/Python , Python preferred.
• Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins,Views etc
• Experience in using Kafka or any other message brokers
• Configuring, monitoring and scheduling of jobs using Oozie and/or Airflow
• Processing streaming data directly from Kafka using Spark jobs, experience in Spark- streaming is must
• Should be able to handling different file formats (ORC, AVRO and Parquet) and unstructured data
• Should have experience with any one No SQL databases like Amazon S3 etc
• Should have worked on any of the Data warehouse tools like AWS Redshift or Snowflake or BigQuery etc
• Work experience on any one cloud AWS or GCP or Azure

Desired Skills and Experience:

• Experience in AWS cloud services like EMR, S3, Redshift, EKS/ECS etc
• Experience in GCP cloud services like Dataproc, Google storage etc
• Experience in working with huge Big data clusters with millions of records
• Experience in working with ELK stack, specially Elasticsearch
• Experience in Hadoop MapReduce, Apache Flink, Kubernetes etc

Soft Skills:

• Team worker: ability to work with teams distributed geographically in different locations
• Proactive, motivated and willing to consolidate and develop a professional career
• Analytical, logical and critical thinking.
• Solid problem-solving skills: ability to identify problems and suggest mitigation and contingency actions
• Ability to deal with ambiguous situations
• Committed and positive.
• Advisory skills

Sobre los proyectos en los que trabajarás

Trabajarás 100% en remoto desde donde tú decidas. En ocasiones es posible que tengas reuniones presenciales y por ese motivo tienes que residir en España o en la Únión Europea.

Trabajarás en proyectos con una empresa líder en transformación digital con pasión por la tecnología y la innovación en sectores como la banca (35 de los principales bancos a nivel mundial trabajan con nuestro cliente), seguros, industrial y automoción en proyectos de Big Data, Blockchain, IA, Cloud, entre otros.