Every year, the holiday season is a huge test for a bunch of people.
They are database engineers.
Because there are predictable traffic surge during major campaigns such as Black Friday, Cyber Monday, and Double 11.
Have you ever thought about this:
Why the payment process won’t stuck when hundreds of millions of people pay together?
Because database engineers are showing their power.
Let’s see what database engineers are doing during the holiday season:
Sort out the system chain for the huge campaign
Design the full-chain database flow chart
Predict traffic
Predict the database performance bottleneck
Plan traffic limit rules for critical apps, degrade non-critical apps
System patrol before the huge campaign
Make sure there is enough space to store data and logs
Decide which tables need to re-collect stats info
Optimize slow SQL queries for critical businesses in advance
Sort out where to monitor during traffic surge
Make sure key clusters are under monitoring
Perform stress test against the entire processing path and locate potential bottlenecks in advance
Make incident response plan
Stop auto backup jobs
Avoid IO and network jam for the follower nodes
Look retrospectively at the issues and problems of the past years
Analyze the root causes
Never stumble twice against the same stone
As the super heros behind the scene during holiday season
Database engineers start preparing for this event three months in advance
Is there anything missing here? Let us know by leaving comments below!