Apr
21
WebHack#43 Challenges of Global Infrastructure
Challenges of Global Infrastructure at Rakuten
Registration info |
参加枠1 Free
FCFS
|
---|---|
参加者への情報 |
(参加者と発表者のみに公開されます)
|
Description
About WebHack
If you believe building relationships with people who are in the same industry helps you know yourself and achieve what you couldn't do alone, this month's event is for you!
If you value continuously learning, read WebHack Monthly and follow @WebHackMeetup to keep receiving valuable contents & earlier updates 👨🎓
- Twitter: @WebHackMeetup
- Offical Website: https://webhack.cc/
About this event
This time, we are honored to co-host an event with Rakuten to share their precious experience on a large-scale cloud platform!
Rakuten, one of the biggest e-commerce companies in Japan, has been integrating infrastructure globally.
In this event, you can see how Rakuten developers manage a big number of clusters and components, how to make it orchestrated and scalable.
You will also learn how their big data is managed, as a good use case of utilizing Kafka and Hadoop for large-scale services.
After the presentations, you can also ask questions for them. Don't miss out on this great opportunity!
Event URL
Feel free to write real-time collaborative notes at HackMD
Talk 1: Rakuten Platform Overview
Description
- The number of services, IDs and data centers in the world
- Developing a global self-service private cloud
- Integrating multiple platforms
- Future challenges
Speaker
Mitchell Klijnstra (Mitch)
Vice Senior Manager, One Cloud Project Office
Talk 2: "Unclouding" Container Challenges
Description
Goal of CaaS, Container as a Service, to provide opinionated container orchestration for Rakuten Group
Major challenges
- Less admins but large number of clusters and components to maintain
- Cannot scale people, but infrastructure should be scalable
- Solution - write software solution for everything instead of doing SysAdmin + Scripts
- CaaS - wrote a ton of in house operators and tools to make this possible
- Future challenges
Speaker
Harpratap Layal (Harry)
Software Engineer, Application Platform Group
Harpratap has been working on various infrastructure projects inside Rakuten, focused on improving developer productivity through standardized platforms
Talk 3: Kafka & Hadoop in Rakuten
Description
- How big scale of platform service we are running (Kafka/Hadoop/ES)
- How to process and utilize data on the streaming
- Future challenges
Speaker
Yongduck Lee (Daniel)
Manager, Data Product Management Office
Senior Architect and Lead of Project/Product Management Office at Data Storage and Processing Section in Rakuten,Inc. Started as recommendation engine developer and have been providing a large scale of Big Data Solutions (Kafka, Hadoop, ELK, NiFi, Couchbase, and so on) with members. currently focusing on researching and verifying new Big Data Technology and how to support users who want to use Big Data System.
Language
English
Schedule
Time | Session |
---|---|
19:30 - 19:35 | Introduction |
19:35 - 19:45 | Rakuten Platform Overview |
19:45 - 20:00 | "Unclouding" Container Challenges |
20:00 - 20:15 | Kafka & Hadoop in Rakuten |
20:15 - 20:30 | Q&A |
20:30 - 21:00 | Networking |