Data Engineer

Requirements
(1): Technical Skills, Job Experiences
【Minimum qualifications (Must Have)】

• 3 years of practical experience in data / analytics with at least 1 year working in an engineering / BI role.
• At least 1 year of practical experience working on data pipelines or analytics projects with Python and
  SQL.

【Preferred qualifications】

• 5 years of practical experience in data / analytics with at least 2 years working in an engineering / BI role.
• Experience with NoSQL databases (DynamoDB, MongoDB, Elasticsearch, Redis, Neo4j, etc.)
• Strong knowledge and practical experience working with at least 3 of the following AWS services: S3, EMR, ECS/EC2, Lambda, Glue, Athena, Kinesis/Spark Streaming, Step Functions, CloudWatch, DynamoDB.
•  Strong experience working with data processing and ETL systems such as Oozie, Airflow, Azkaban, Luigi, SSIS.
• Experience developing solutions inside a Hadoop stack using tools such as Hive, Spark, Storm, Kafka, Ambari, Hue, etc.
• Ability to work with large volumes of both raw and processed data in a variety of formats (JSON, CSV, Parquet, ORC, etc.).
• Ability to work in a Linux/Unix environment (predominantly via EMR & AWS CLI / HDFS).
• Experience with DevOps tools (Jenkins, GitHub, Ansible, Docker, Kubernetes).

(2): Behavioural Skills

• Able to effectively communicate with internal and external technical and user teams.
• Capability to make complex ideas accessible
• Fast adaptability, Self-starter, autonomous
• Focused on solving problems
• Result-oriented

(3): Certificate, Education Background

• Master’s degree level in computer science field (or equivalent experience)

(4): Language Skills

• English (mandatory): Basic English skills for communication especially writing skill. It will be the main working language.
• Japanese (mandatory)

Good to have: (if any)

• Candidates with strong Python, SQL skills and experience with data modelling in a cloud environment are encouraged to apply.
• The client works mainly with AWS but candidates with relevant GCP, Azure or Databricks
• Python and SQL skills are absolute must have requirements for this position.