Unity Ads is the go-to ad solution for increasing player engagement and achieving mobile success. It enables developers and publishers to acquire high-quality users and grow revenue with video ads integrated into their mobile games. More than a third of the top 1,000 free mobile games are made with Unity Ads technologies.
With the increasing complexity of mobile app testing, Rasmus Selsmark, QA Lead at Unity Ads, needed a solution that could help his team focus on innovative Agile development, while improving test coverage and confidence. The solution also needed to help Unity move faster and bring quality SDKs to game developers in a shorter timeframe.
Addressing the Increasing Complexity of Mobile App Testing and Delivery
As the complexity of mobile app testing continues to grow, Unity relies on a variety of tools and services to help them build, test, and deploy quality software. “Automation is important for us to get different teams, tools, and environments integrated, and help us get deliverables to move fast through our pipeline,” says Rasmus.
“Back in the day, we were happy with automating our tests locally on multiple devices. However, we gradually saw an increasing workload on infrastructure maintenance. We also wanted to increase our testing coverage to ship our SDK with greater confidence.”
The company needed a cloud-based test automation solution that would let them integrate their existing tools to streamline their CI/CD pipeline, increase mobile device coverage, and improve confidence in their software’s quality.
Moving Local Automated Tests to Cloud-based Infrastructure in the Shortest Time Possible
In 2015, Unity looked for ways of building robust test automation and using different cloud-based device farms. ”Prior to BitBar, we evaluated a few other test automation solutions. We wanted to get automation up and running as soon as possible by sticking to open source frameworks. BitBar did a good job at supporting all the open standards and providing comprehensive APIs that meet our need of a customized testing approach. This allowed us to seamlessly integrate with our tools and directly pull test reports to our developers,” explains Rasmus.
“On the other hand, we wanted to lessen the pains of hosting in-house environments. That’s where BitBar again came in with unique device models and OS versions from different countries. During our POC, we also realized that BitBar has the ultimate scalability, in that we can execute tests on any number of devices in parallel. That would significantly boost our test efficiency.”
Delivering Quality SDKs with Improved Confidence
“Automation nowadays is widely adopted in many organizations, but we also wanted to set it up in a way that actually calls out value,” Rasmus emphasizes. “By saying value, we meant that it should help us build, test, and deploy software at a daily rate with confidence. With BitBar’s solutions, we’ve realized our goal.”
BitBar has several out-of-the-box integrations with development, ticketing, issue tracking, deployment, and collaboration tools so customers can easily optimize their DevOps toolchains. Unity relies on BitBar’s comprehensive APIs to integrate their build system with BitBar, so each build can be passed through the pipeline for extensive QA over the API. Unity utilizes Jenkins and Travis on a daily basis to trigger tests executed on a large set of devices, thanks to the capability of unlimited device concurrency of BitBar.
“BitBar has a versatile device cloud. Every time we want to replicate or debug reported issues on a specific device, we can always find the right device model from BitBar,” says Rasmus.
With BitBar, we have implemented an optimal DevOps process. The automation and scalability of BitBar allows us to execute more tests on more devices within the same amount of time. This gives us the confidence to move our SDK through all phases of the pipeline and deliver quality SDKs to game developers rapidly.
Unity has been a happy customer of BitBar for over two years, and sees BitBar as a crucial tool in shipping their SDK.