Katalon Studio Features

1- that you can use cucumber scripts along with groovy for automating test cases 2- Katalon Analytics is great

1- you can not open more than one project at a time 2- it's very heavy, it consumes a lot of resources. I think it could be improved in terms of RAM and CPU management. 3- katalon analytics needs more improvement, there are some issues in the UI. 4- the logging motor can be better, right now is very unusual if you run multiple test suites at a time with suite collection and try to watch the logs for each and every test suite, you get lost and it's hard to know even when it finished executing. 5- The Katalon Studio UI (at least mac version) it's complicated to use when you create a Request, it's hard to define the variables and params since the components used are very archaic, some time you think you save (according to the common behavior in most of the tool) but you actually dont and lost all changes. That can be improved. 6- The way Katalon manage the project files etc. it's very complicated to deal with those non-sense files (for end user) and the repos, it generates a lot of conflicts everytime.

User friendly UI, support team's response and openness to suggestions, one tool for multiple tasks

It could be more dynamic in terms of recommending error / corrections

I like it because It's % Free tool and It's very easy to use with an excellent user interface. It helped me to test some Automation tasks using an Excel spreadsheet and I find it very useful especially the record option because I don't need to code anything I just need to click record and start to do my task from A to Z and after this, I will just put everything into a Loop and all my tasks are fully Automated. It's very easy to use and I saved a lot of time using it because I don't have much experience as a programmer and to get someone to program an Automation tool for your business is very expensive but, with the Help of Katalon Studio now I have the Knowledge to Automate any simple task I have. I run some tests on multi browsers and It's very easy to create cross-browser testing and It allows me to do multi API and Web service testing too. I love when I get real-time reports about the performance of my test so, I can fix the bug without checking everything. I like the pre-installed templates because for someone with a little knowledge of coding I can just use Katalon templates and they get the work done without any problem. They have an amazing support team and a lot of blog posts and question answered on their Community website also, I like when they send me a lot of useful tips and tricks by Email weekly and there's a lot of YouTube Videos about this tool and I learned a lot from it too.

They can add more features and integrate with other testing and automation tools because this will help in saving a lot of time. They can improve their Recorder tool and they can add more Browsers too.

- Availability of tutorials - Ability to design Test Cases using Editor with the pre-defined set of commands - Comfortable UI for Dev & QA team (it has Eclipse-like interface) - It is a feature-rich solution to address most of the tasks - Ability to use the tool for Web UI tests, REST API tests and mobile testing

- Reporting for BDD tests should be improved. It should display more meaningful information about the steps performed in a readable way (BDD test looks actually more meaningful than a report - that is weird).

I can use my Selenium and Java experiences. Learning is very easy. You can do anything you need for automation including GUI, API, Mobile in one tool. Very productive for Automation.

Having difficulties to integrate with AWS Device Farm

Katalon is user friendly, even for a non-developer. It records the steps within an app to create the test scenarios with ease. You could also manually write the test scenarios, step by step.

The only con with the software is resolving issues sometimes requires a developer to help fix the test case.

Katalon is easily one of the best open source software tools for GUI automation testing. Its intuitive interface requires a minimal learning curve and with the official documentation online, someone with zero testing/coding experience can write a comprehensive test. Test suites and collections allow enterprise level testing by allowing users to run numerous tests in series or parallel in different browser configurations. If you have some experience as a programmer, Katalon's modularity allows it to be extremely flexible. Programmers can write robust keywords (functions) and classes, that can extend testing functionality. The Cucumber integration makes it easy to write BDD tests. Katalon also allows you to import .jar files to extend functionality making the program even more robust. Katalon also runs its tests quickly and provides users to run tests through command line allowing for Jenkins integration which is necessary for enterprise level testing.

Katalon is an excellent software, but it is not without its bugs. For convenience I will list them: - Biggest issue is documentation. There is some great official documentation for Katalon, but there is also a lack of basic API documentation. I had to go to a Katalon forum to figure out about object parameterization. Why are the Web UI functions not explicitly documented? The links to the docs I've seen online are all dead. - Issues with building project path/classes: sometimes if you try to write classes and use them in other classes (OOP) Katalon will not recognize the class and you have to restart the program for a clean build. This was most prominent in how the Cucumber tests have to be structured. Feature files and step definitions have to be in specific locations, and there is not really any official documentation for this. - Git integration: While Katalon does come with Git integration, integration is limited to a project scope. If you clone a project through Katalon's interface, it treats the entire repository as a project which is kind of annoying. - Reports: It seems strange that Katalon offers so much flexibility but then doesn't allow users to customize their reports and build them as they see fit. - Object repository: There should be a way to import test objects/have a shared object repository between projects. Can you just put all your tests under one project? Yes, but it doesn't always make sense to do so and can lead to a cluttered project.

I started using Katalon Studio a year ago and it serves the automation needs for the applications I use at my workplace. It’s free of cost which is a huge bonus, easy to automate and user friendly. To start with it’s very simple to create a record and playback script which can be edited using a manual and script mode with lots of inbuilt keywords to perform validations. My basic knowledge on Java enabled me to create new custom keywords and methods in Katalon library. I could efficiently use the Built in reports to consolidate the test results. Data driven testing support helped to cover all possible test scenarios. I managed to use the Integrations with JIRA which worked perfectly fine and saved a lot of time for documenting test evidences and integration with GIT served the script version control. Joining the Katalon Community was very helpful to get online support and obtain solutions to my queries using this forum. The community is open to suggestions and they do consider the required improvements to incorporate in the future versions they release. I would suggest every user with minimum coding experience give it a try as you do not have to pay any cost and no limited using time

Every automation tool has some drawbacks, but I managed to nd workarounds for each stoppers. Since Katalon studio is a tool that is still developing, I expect it will be more powerful in near future, supporting more functions and needs of the user.

Was able to automate most of the manual testing work using Katalon studio. Thus saving time and efforts and putting those to use in more productive work. The experience was great working on Katalon studio. The frequent updates of the software, the added enhancements every now and then are perfect. Quicker responses is what one can expect. Coming to the tool, its a great tool to work with. To sum up its a great tool which we can employ without any cost to pay for.

It crashed many times without saving the changes I did. Katalon community can be improved. I strongly felt that it should have a revamped User Experience, in terms of color schemes, ease of use and more shortcut keys to be included. Coming to the technical functionalities in the tool, sometimes while after including certain files from a particular folder, it doesn't appear there directly. We have to refresh the tool. It would be great if the tool had some auto-refresh feature. Sometimes while saving an Object Repository file, even if I save file, I am not able to save file and the changes are lost. I feel that improvements can be made on architecture level to sort out all these issues. The tool should be asset light, means should be able to work on minimum computing requirements.

You're able to start creating UI scripts right away and then be able to figure out how you want things laid out as you go along. To get Katalon to work the way you want, you do have to do a fair amount of customization. By that I mean figuring out how you want to model your tests and test objects, whether it's UI, API, or a hybrid. This may sound bad, but there's enough there to start out with that you're not hindered by initial setup if you're already coming from another tool or similar framework. Groovy AND Java work well in Katalon with Groovy being the main language for scripting. Groovy is VERY forgiving.

Refactoring is probably my biggest gripe. You can easily refactor variables and shared code in Eclipse, but that seems to be a thing that is missing in Katalon. When it comes to updating test case names or the web objects, those get updated across the board enough, but not when it comes to passing variables and keywords around. The need to customize a fair amount for satisfactory integration with something like JIRA/Zephyr. Updating doesn't always work (I use a Mac). When I start executing tests, there's usually a delay/lag when things actually start or report.

Powerful tool but easy to use and simple to deploy Open Source Tool Single tool provides features to perform Web UI, Mobile and API automation Supports Page Object Modal Provides Object Spy feature Provides cross browser testing It has both manual and script mode It has many pre-defined methods which helps the manual testers to create automation scripts Releases feature updates frequently Provides integration with various 3rd party tools like TestRail, qTest, Git, Jenkins Provides great reports.

Paid support Frequent feature release takes time for installation everytime

It is very user friendly and has loads of functionalities that makes automation testing look so easy and simple. Apart from providing automation solution for web, mobile, and api platforms it also has very useful add-ons to connect to test management tools which makes it very interesting to link tests and bugs directly .

I would prefer that they have some more extensibility for desktop app like java apps, spring etc

1. Parallel Execution 2. Developing the scripts in different modes 3. Keywords concept 4. Katalon Analytics 5. Maintaining Objects easily and customizable with different locators 6. Test Listeners helps a lot 7. Plugins concept is really awesome. Saves a lot of time 8. Regular updates from the team 9. Quick response from Katalon Community and Katalon developers

1. Uses more System memory 2. Proposals will not be displayed properly 3. Any errors while developing a script are not displayed. Only when we run we get the errors in the console 4. Some of the jars are very old and those are not updated in the library

Katalon have good feature of record and play back which avoids script for the tester. It is keyword driven testing tool. Recently, Katalon launch plugin feature which is very great to have to it as plugin replaced some of the keyword written by our team. Also, anyone can use this tool like technical and non-technical member.

Windows testing is not available in Katalon. Sometime tool behaved unexpected like test cases fails and at same time some test cases get pass. Not stable tool.

The best about Katalon is that test cases can be created easily using the visual interface (katalon recorder), but can later be made more powerful using the scripting tools. It's also great to be able to export them and reimport them easily, allowing our team to collaborate adding new test cases with each passing version. We haven't yet integrated katalon with Jenkins, but knowing that its possible is great for us.

It took a bit of learning at first, since we used other tools before, but once that was done it's relatively easy to use. The community of users is not that large, but its apparently greowing since users from selenyum are mostly migrating to katalon. We've had some performance issues with it, and some cross browser differences, however, this didn't happen often.

The beginner friendly aspect of this software makes it great for anyone to begin testing right away. Having the option of capturing browser actions without the need to necessarily having to write the script from scratch made it very straightforward to use. At the same time, having the option to easily customize the script makes it very flexible and helps get necessary testing done quickly.

The only issue I've ran into while using this software was some bugs when testing on certain browsers. At one point I had some issues when attempting to run a test on Safari due to some driver issues. There are also some small bugs when running tests on Internet Explorer with window sizing. There were some workarounds for these issues and I was still able to test on all browsers.

The tool is suitable to all people who will know and don't know the code, framework, error handle, data driven and deployment.

1. I have faced some issue on sometime, like not able to call the method from keyword to test case. 2. Request to Katalon team to provide more reference.

Recorder and Playback for beginners, Keyword Driven for intermediates, or Java/Selenium Webdriver for advanced usage. Direct Integration with Git, Jira, Browserstack, Docker, Kobiton, Jenkins, and a console mode allowing Integration with Azure Build pipelines, or anything supporting command line execution. Supports Page Object Model, full Java , Groovy, and Selenium Webdriver syntax directly Based on Eclipse IDE which some will find familiar. Cucumber support for BDD /ATDD Extendable with external with java package imports API testing facility rivalling Postman built in Fully documented features Developers listen to the community

Growing community, but still in its infancy Analytics tool but still in Beta Support for many integrations, but requires a lot of research to get these working properly Lack of support for .NET languages (although hardly a compromise)

1. It's free 2. Very easy to use 3. Lots of built in features 4. Easy to integrate with other tools 5. Low learning curve

1. No Support at all, you have to buy a package even if you need a small question answered. 2. Would have liked if the inbuilt keywords were customization. Need to have more features which allow to build more features like recovery scenarios etc. 3. Managing the project on git is difficult. Faced difficulties in collaborating across the team. 4. Frequent version releases and poor backward compatibility

1. Integrations with GIT, Bitbucket, Slack 2. Data binding 3. variable binding 4. Execution settings 5. Compatible with other languages even though it is running using groovy 6. Profiles 7. Data files

1. Better to have options to connect multiple databases with windows auth mode 2. Execution reports in katalonanalytics seem not running properly 3. API automation report doesn't have the flexibility to trace the issues easily we need to do many clicks

Good feature have in testops to schedule build in different environment , it's makes easy to execute in different platforms parallelly.

While scheduling build in testops either cloud or local it's being in "Quee" longtime. And some time with out executing it's showing result "Pass" it's a defect we already raised to support team. And while active the local agent it's taking couple of minuities to show the agent in online.

Katalon permite automatizar tanto pruebas de frontend como de servicios REST y SOAP, la automatización de servicios es muy sencilla mediante el uso de objetos de prueba y scripts de ejecución en lenguaje Groovy (una implementación de Java) con lógica extensa tanto para las llamadas a los servicios como con sus verificaciones. La automatización de frontend implementa selenium y ocasionalmente tiene algunos inconvenientes por el acceso a los elementos mediante locators, especialmente en sitios que usan componentes dinámicos sin identificación clara de que es cada componente.

Que la versión gratuita no permite importar definiciones de swagger/open API 2.1, este solo se encuentra en la versión paga.

- Easy to use because it has feature record and play so no need coding skill to use their feature - Good user interface - No need to worry about web driver like other automation tools - Katalon has feature to support Web , Mobile, API automation testing - It has feature to support Continuous Integration testing tools - It has ability to handle cross browser testing

- Its use pretty big memory so some times its impact to performance issue (like crash or slow) when run many scenario - only Katalon 7+ version licensed owner, that able to use debugging feature - its limited to Java and Groovy

Very fast to get up and running. Fits a variety level of users, flexible enough to allow advanced users to pretty much setup how they please at the same time enough of all the base needs for the new user. With it being free product, they update it regularly and are very attentive to user requests. Their application is actually fun to use. The setup and options are intuitive. Not hard to figure out how to do and implement even more complex, complicated operations with custom code. Very portable. The install being as isolated from the code, can easily install on another machine, and open project and be running tests, no special build, or install requirements to do this as I've seen in other tools.

Not a fan of the Object Repository handling, doesn't do well of detecting dupes, can get quick messy if user of the object spy. The code repository integration is basic, the interface to it not very robust. Its scripting language is Groovy, which is not as popular as others.