Apple Search Ads (ASA) is a vital tool for app developers to enhance their app’s visibility in the Apple App Store. By effectively managing ASA campaigns, developers can ensure their apps appear at the top of search results, thereby increasing visibility and potential downloads. Traditional campaign management strategies have relied on manual input and fixed rules, limiting flexibility and adaptability in a rapidly changing online market. Powered by Reinforcement Learning, this project marks a significant advancement towards fully automated ASA campaign management, capable of making informed decisions on budget allocation, CPI targets, and keyword bids without manual oversight.