Data Engineer

Contract type
Web Marketing / Advertising
Company Type
日系企業/Japanese Company
5 Million yen〜12 Million yen
Japanese Level
ビジネスレベル/Business Level
English Level
Other Language Skills

Job Description

The company data has been accumulated enormously every day from services that have the top share in Japan. Recruit's data engineers handle this data and contribute to the creation of new value in a wide range of areas. The Data Promotion Office is an organization responsible for data utilization, data governance management, data product development and operation in the company. Currently, there are about 300 employees, and employees with various expertise in data science/engineering/business belong to it. ■ Style aimed at by the Data Promotion Office They aim for a style in which engineers and data scientists work across all business areas to achieve business expansion and personal growth at the same time. ■ The future image of the Data Promotion Office ・ To proceed with maintenance so that 45,000 employees can use data safely and freely. ・ Rather than only some engineers and data scientists using data, using data with all employees causes “unpredictable big changes” ・ To create an environment where data can be utilized and to create a future that one cannot imagine, data can be safely and freely used, and the ground is steadily solidified for the next generation of excellent people. ・ To "science and engineering" the core competencies that generate profits. Establish a style of growth with the power of technology and strengthen business competitiveness [Role of work] ・ Perform practical work such as system development and operation necessary for data utilization to achieve business goals ・ Architecture design and implementation for mass data processing for data utilization ・ Enhance and operate the system in charge [Specific business example] ・ Project planning / promotion / review, process improvement ・ Achieved KPI / QCD for system development ・ Achievement of SLA system goals in the system in charge ・ Formulation of a refactoring plan to improve the value of the system in charge ・ Pipeline development and operation for data utilization ・ Development and operation of a system that performs high-speed processing of large amounts of data An example of the development environment 【Development environment】 ・ Programming language SQL, Python, Java, etc. ·infrastructure GCP (BigQuery, GCE, GCS, GKE, Cloud Composer, Cloud Pub / Sub, etc.) AWS (EMR, Redis, Elasticsearch, DynamoDB, EC2, S3, SNS, etc.) ・ Team development tools JIRA, Confluence, GHE, Slack, etc.

Required skills

(REQUIREMENTS) Understand the basics of algorithms, and be aware of various restrictions such as the amount of calculation, and can perform appropriate programming without being restricted by the implementation language. Based on business requirements, it is possible to design an appropriate architecture including using various technologies such as cloud computing. Have knowledge of the system development process and can utilize it. (WELCOME) System operation design can be performed considering the viewpoints of abnormality detection, failover, backup, etc. Having knowledge of system security, he can lead the response in cooperation with experts when a security incident occurs. Can lead team development centered on engineers.