Data Engineer【Publishing Industry】

Data Science, Data Engg | Web, Mobile App (Frontend / Backend) | Cloud | Lead, Management Role

Location	Chiyoda-ku, Tokyo
Company	A joint venture founded by a trading company and 3 major publishers, aiming to bring sustainability to Japan's book distribution by digital transformation, including effective use of RFID and AI-driven optimization in publication / distribution.
Job Description	[ Role ] The recruiting company is building a workflow engine system using Apache Airflow and providing a platform with the mission of providing a data collection and processing infrastructure system and making publication distribution sustainable through data utilization. In this position, as a data platform engineer, you will be responsible for expanding the platform, as well as improving, investigating and verifying operational operations to cope with new customers and new measures. This is a very rewarding job that requires a wide range of technical understanding from the hardware layer, including networks, to the application layer. [ About this department ] The department provides supply chain optimization service powered by digital transformation (DX), in order to achieve sustainable publishing / distribution. Although coordination will be tough as there are many stakeholders that are publishers, distributors, and book stores, this is a rewarding position to be able to throughly transform the supply chain from up- to downstream. If you are tired of desktop verification, or wish to take on a new role, please join us in the challenge of industrial transformation! [ Technology stack ] Programing language: Python Framework: Apache Airflow Infra: Terraform Container: Docker GCP: Cloud Composer, Cloud Run, Cloud Functions, Big Query
Requirement	Mandatory: Two or more of the following - Experience in platform development, operation, and troubleshooting - Development experience using scripting languages (JS, Python, PHP etc) on the cloud - Practical experience in development using RDMS such as PostgreSQL - Experience using public clouds (GCP, AWS, Azure) - Experience building systems for workflow engines such as Apache Airflow, Apache NiFi - Database system design/tuning experience Preferred: - Environment construction and development in GCP - Data engineering experience - Experience in building and operating DWH such as Redshift, BigQuery - Project leader/sub leader experience - Network knowledge
English Level	NA
Japanese Level	Business level
Employment Type	Permanent

Less than half of all openings are posted.
We may have prospective / non-public opportunities to introduce to registrants.
(Click here to register)