Senior BigData Engineer

Неактивна


Технологии:
etl design collaboration education bigdata python pyspark spark aws english pandas
Английский: eng: Intermediate

Purpose of the job:


As Senior Engineer you will build an ETL solution in marketing domain, which involves data transformation, applying models and loading for further analysis.

MAIN TASKS AND RESPONSIBILITIES:

  • Design, develop, deliver and operate scalable, high-performance data processing software.
  • Work proactively on the system architecture.
  • Ensure high quality development standards (unit/integration tests, etc.)
  • Collaboration with the product management team to incorporate the needs of our customers.

EDUCATION, SKILLS AND EXPERIENCE:

MUST HAVE:

  • 5+ years with BigData technologies and tools.
  • 3+ years of Python development experience (Python, Pyspark)
  • Strong hands-on experience with Spark
  • Handling scalability issues, pipeline/cluster optimization
  • Experience with AWS
  • Good English (oral & written) and communication skills in general

WOULD BE A PLUS:

  • Pandas, databricks/koalas.
  • DevOps experience for Big Data solutions.