Cloud Native ✖️ Best Practices for Microservice Architecture in the AI Era - CloudWeGo Technology Salon·Beijing Station Registration Opens

[Shenzhen] Yuanchuanghui: 5.26pm, the party hall is waiting for you.”

activity description

Since CloudWeGo was open sourced for more than two years, the community has developed rapidly and the ecology has become increasingly rich. There are more than 40 enterprise users , covering multiple industries such as AI, e-commerce, finance, and games . At the same time, as cloud native technology and AI technology continue to flourish, we find that enterprise users are also facing more and more challenges in performance, cost and stability. The system needs to support elastic scaling and stability under tidal traffic, so There is also an increasing need for a high-performance, easy-to-expand, and feature-rich microservice architecture.

Community users and developers are sincerely invited to participate in the CloudWeGo Technology Salon. The event will be held in Beijing on March 30, 2024 (Saturday) , inviting technical colleagues to discuss how companies can build a cloud-native microservice architecture under the wave of cloud -native xAI to support the rapid iteration and development of products.

Topic introduction

The topics shared at this event will focus on the implementation of CloudWeGo related technical functions, and how to leverage the CloudWeGo open source project to help enterprises build microservices. CSDN, Rare Earth Nuggets, Volcano Engine Developer Community, and ByteDance technical team will serve as partners. Simultaneous promotion and live broadcast. The event invited many Maintainers and Committers from the CloudWeGo community to share the design and implementation solutions of Kitex and Hertz in AI scenarios. Engineers from Founder Securities and ByteDance Flow were also invited to share the implementation practices of CloudWeGo. We sincerely invite more people with microservices Implemented enterprise users and developers participated in the exchange.

Keynote Speech: Design and Implementation of Kitex Thrift Streaming

Lecturer: Feng Min, CloudWeGo-Kitex Maintainer
Outline: With the rapid development of AIGC/LLM, ByteDance's internal demand for Streaming is more urgent. Based on Kitex's gRPC/HTTP2 transmission protocol, CloudWeGo has extended support for Thrift Streaming and improved the original Kitex/gRPC service governance capabilities. Observability and ease of use have been improved, with further performance improvements planned using the TTTheader transport protocol in the future.

Keynote speech: Hertz SSE implementation principle & implementation in AI ChatBot

Lecturers: Fan Shuyang, Wan Ziyu, CloudWeGo-Hertz Committer
Outline: SSE (Server-Sent Events) is a mechanism for the server to proactively send data to the client, providing one-way streaming capabilities based on HTTP. With the popularity of AIGC/LLM, both ByteDance and the community have strong demands for SSE. The two students will share the principles of SSE, the design and implementation of Hertz SSE, and demonstrate how to use SSE capabilities to build an AI chatbot.

Keynote Speech: Financial Technology Go Microservice Construction Practice

Lecturer: Liu Yi, senior R&D engineer at Founder Securities Financial Technology Engineering Institute
Outline: This speech is a summary of the process and experience of Founder Securities in practicing Go microservices from scratch in the past year, including: the road to microservice framework selection, the first close contact with CloudWeGo; the observability construction that the financial industry is concerned about Practice; and service interface management and construction practice based on Kitex.

Keynote speech: Implementation of Kitex Thrift Streaming in AI scenarios

Lecturer: Du Shaofeng, ByteDance-Flow R&D Engineer
Outline: This sharing will share the experience and problems encountered by the Byte Prompt platform in implementing streaming interfaces with the help of Kitex Thrift streaming. The Byte Prompt platform needs to provide convenient full life cycle capabilities such as Prompt development, tuning, evaluation and application for upper-layer businesses. Among them, the streaming output of large model results with typewriter effects must be supported. If the implementation based on SSE also needs to write an http service, the rotation-based method is too ugly, and the gRPC-based method may cause compatibility issues. Kitex developed the Thrift streaming capability in response to domestic demand, so we became the first to implement the streaming interface in the Prompt platform with the help of Kitex Thrift streaming.

round table discussion

Host: Luo Guangming
Roundtable guests: Feng Min, Fan Shuyang, Liu Yi, Du Shaofeng
Outline:
- What are the secrets and experiences of quickly building a microservice architecture?
- How CloudWeGo helps products improve performance, stability, development efficiency, reduce costs, etc.
- Microservice development, CloudWeGo framework design and insights into AI-related ecology, future technology development ideas, etc.
- On-site Q&A

Sign up now

Visit the event page to sign up. Participate in on-site interactions and have the opportunity to receive exquisite peripheral gifts from the community. To learn more about the CloudWeGo project, please visit www.cloudwego.cn and look forward to your participation!