Waydev, Pluralsight Flow (ex GitPrime), Code Climate, or Pinpoint? This article provides a comparative analysis and helps you decide which one is suitable for your team.

When an engineering team scales, you start losing visibility:

  • A higher code volume increases the difficulty in diagnosing problems.
  • A more significant number of engineers makes it harder to spot who has encountered a blocker or who might be overloaded.
  • Managing multiple projects makes benchmarking your team performance tougher.

waydev-gitprime-pluralsight-flow

Even though you start losing grip, you need to meet deadlines, deliver value, and continuously boost your team’s productivity. This is when you might want to dive into Git Analytics tools. Some of the more popular and reliable intelligence tools include Waydev, Pluralsight Flow (ex Gitprime), Code Climate Velocity, and Pinpoint. These can help you to regain a clear picture of your team’s output and ensure your team is working efficiently and achieving goals. It’s easy to grasp the things these tools do, but how will you interpret the data, and what decisions will you make based on it?

To help you choose the decision that is the best fit for your needs, we created a comparative analysis of the most popular Git Analytics tools: Waydev, Pluralsight Flow (ex GitPrime), Code Climate Velocity, and Pinpoint. We also added a ‘Build Your Own’ section. Below, we’ve put together a brief table of contents for this article so you can skip to the part you are interested in.

Getting Started

Data Sources

Performance Benchmarking

Locating Problems

Customizations

Pricing

Getting Started

You have probably gone through tens of registration processes before, so this shouldn’t be too demanding for you. As soon as the data has been imported, you are into action.

Waydev

Set up your Waydev account by signing into your GitHub, GitLab, Bitbucket, or Azure DevOps account and authorizing Waydev’s access. Choose the repositories you want Waydev to analyze and then click the ‘Load Project’ button.

waydev-vs-flow-vs-gitprime-setup

Pluralsight Flow (ex Gitprime)

Pluralsight Flow’s setup is much the same as Waydev’s setup. Select your data provider, authorize access, and check the repos for Pluralsight Flow (ex Gitprime) to analyze.waydev-vs-flow-vs-gitprime-setup2

A benefit of using Pluralsight Flow (ex GitPrime) is the range of control systems with variable workflows. You can connect to your GitLab, GitHub, or your Bitbucket to import your repositories. From GitLab, GitHub, or Bitbucket, you can arrange your repositories according to its tag. A contributor can be integrated into teams or concealed from reports.

Waydev provides integrations with GitHub, GitLab, Bitbucket, Azure DevOps, and their on-premise counterparts. The access can be granted through OAuth or Personal Access Tokens. Waydev also allows SSO integrations through Okta and offers an API.

Pluralsight Flow (ex Gitprime) supports mainly similar integrations, besides Azure DevOps. It additionally supports Jira integrations.

Code Climate Velocity

Code Climate Velocity does not allow connections to GitLab, Azure DevOps, and their on-prem counterparts. Code Climate Velocity also doesn’t allow on-prem versions of GitHub and Bitbucket on their Essentials and Professional plans. Moreover, Code Climate Velocity offers API access only on the Enterprise plan.

Pinpoint

Pinpoint integrates with all the major Git providers, but it will not provide users any data before they connect Jira. Pinpoint is not available on-prem.

Build Your Own

Developing your software can take some time. Setting up tools such as Waydev, Pluralsight Flow (ex GitPrime), or Code Climate Velocity can be operational upon the import of your data.

Data Sources

The data span of Waydev, Pluralsight Flow (ex Gitprime), Code Climate Velocity, and Pinpoint is much the same. The difference lies in the insights they focus on. Gaining an equal number of sources in your own build can be met with much complexity. It is important to note that your analytical needs to be transparent and insightful. Incomplete software builds mean a lack of precision in the data that is gathered.

Waydev

Waydev is designed to import information from popular Git applications like GitHub, GitLab, Bitbucket, and Azure DevOps. Waydev’s focus is evenly distributed across the code-level metrics and the code review process. They discovered a way the code review process can be quantified into actionable metrics, which can enhance an engineering manager’s visibility over his team collaborative activity. These insights can be used to spot a blocked pull request, incentivize engineers to collaborate more or adjust the workload.

Waydev’s code-level metrics are directly related to engineering productivity, while the code review process is quantified in collaborative metrics. Some examples of the metrics are:

  • Impact, which is a gauge for the cognitive load an engineer’s input carried. Calculating an engineer’s performance by the amount of checked-in code is an unreliable measure of productivity, so Waydev created a formula that can better summarise engineering performance. The things taken into account when the Impact is calculated, are the amount of code in the change, the percentage of old code edits to new code added, the number of locations the changed code touched, the severity of old code changes and how the change compares to others in the project’s history. waydev-vs-flow-vs-gitprime-impact
  • Churn, which represents the percentage of code that has been rewritten or deleted shortly after being written. Of course, nothing can work perfectly from the first try, but if this percentage is higher than 5%, you might want to analyze this further. It might have only been a change in specifications, but it could also mean that an engineer got the requirements wrong, or that a manager was unclear. This can help you diagnose issues early and fix them in a timely manner.
  • Risk, which measures the likelihood of a commit to cause problems. It takes into consideration the commit’s size, the spread of the commit throughout the codebase, and the importance of the changes to the existing code. waydev-vs-flow-vs-gitprime-risk
  • Review coverage, which calculates the percentage of pull requests that had been reviewed. As an engineering leader, you want your team to continually improve its workflow. This metric helps you gain a better understanding of your team’s code review process and aids you in optimizing engineer collaboration.waydev-vs-flow-vs-gitprime-reviewcoverage

Pluralsight Flow (ex Gitprime)

Pluralsight Flow (ex Gitprime) started by importing the data from Git, processing code-level data only, unlike the collaborative work-related data used by Waydev. This practice enabled integration with multiple tools, such as GitHub, GitLab, and Bitbucket, but the code review workflow insights were narrow. They released a collaborative work package that is not entirely integrated into the reports.

Pluralsight Flow (ex Gitprime) offers its particular collection of metrics, such as:

  • TT100 Raw, which represents the time it takes for an engineer to produce 100 lines of raw code.
  • TT100 Productive represents the time it takes for an engineer to produce 100 lines of code, after churn. Pluralsight Flow (ex Gitprime) recommends looking at this metric alongside TT100 Raw, claiming to represent velocity and quality. waydev-vs-flow-vs-gitprime-timeto100lines
  • Impact measures the difficulty of a codebase change. According to their documentation, the algorithm takes into account insertion points, lines of code, and the number of affected files.
  • Churn, which measures how much code has been altered. This number is affected when any contributor alters any piece of code and could represent wasted effort.

Code Climate Velocity

  • Throughput, which measures the number of pull requests merged.
  • Pushes per day.
  • Cycle time, which acts as a gauge for how quickly code goes from a developer’s laptop to being merged into master.
  • Rework, which represents how often developers work on their recently merged code.

Pinpoint

While Waydev, Pluralsight Flow, and Code Climate Velocity, focus on code-level and collaborative work metrics, Pinpoint’s metrics are oriented towards Project Management. Pinpoint does, however, offer a few code-level and collaborative work metrics. Several Pinpoint metrics are:

  • Cycle Time, which measures the average days from starting a piece of work to completing it.
  • Sprint Health, which combines multiple sprint efficiency metrics into a single value. It takes into consideration the percentage of issues from the initial plan that remain in the final plan, the percentage change in the total number of issues from the initial plan to the final plan, the percent of issues in the initial plan completed in the sprint, the percent of issues in the final plan completed in the sprint, and the percent of issues completed in the sprint that were not in the initial plan.
  • Changes per commit, which represents the average number of code changes an engineer makes per commit.
  • Code Ownership, which evaluates the total lines of code a person has contributed across all repositories.

Build Your Own

Your build will be limited in terms of accessing patented metric systems that you can utilize with Pluralsight Flow (ex GitPrime), Code Climate Velocity, Pinpoint, or Waydev.

Performance Benchmarking

Each of Waydev, Pluralsight Flow (ex Gitprime), Pinpoint, and Code Climate Velocity offer a comprehensive view over project and engineer stats via dashboards that track performance evolution over the timeframe of choice.

This is what Git Analytics does. It searches through hundreds of repositories to provide you with valuable insights, insights that would have taken hours to collect, input, process, analyze, and create a report from.

Waydev

Waydev has multiple performance benchmarking tools:

  • Dashboard, which aggregates the most commonly-used functions of Waydev into one clean panel of graphic data. This overview enables you to benchmark your team’s performance over the selected timeframe, details regarding commits, top performers, and more.waydev-vs-flow-vs-gitprime-dashboard
  • Compare, a feature that enables you to compare a team’s /engineer’s performance to either previous timeframes or other teams/ engineers. You can also filter by repositories.waydev-vs-flow-vs-gitprime-project-timeline
  • Project Timeline, which tracks the work volume over a selected period, allowing you to identify and correlate possible issues to events. This feature also monitors the work trend of your team, showing you how much new code was written, how many lines of code had been reworked, how much of your engineers’ focus went to help other teammates, and how much of the code written had been churned. You can also see the top performers in each of these categories, and adjust your decisions accordingly.
  • Sprints, which aggregates multiple data points from Jira into a proprietary metric – sprint risk. The Sprints feature assists engineering managers in answering questions, for instance: “Is my team over capacity? Is our sprint falling behind? How can we execute sprints better?”

Pluralsight Flow

Pluralsight Flow’s performance benchmarking tools include:

  • Fundamentals, which represent the core of Pluralsight Flow’s product. Four metrics are being analyzed: Impact, Efficiency, Commits per Day, and Active Days. The dashboards display the monthly average, industry benchmarks, and custom targets.waydev-vs-flow-vs-gitprime-fundamentals
  • Review Workflow, (Not available in the Standard pricing plan) is a two-week pull request activity tracker. You can see opened and closed pull requests, zoom in to a pull request and see the comments and changes, and the review status.waydev-vs-flow-vs-gitprime-review-workflow

Code Climate Velocity

Code Climate Velocity performance benchmarking tools include:

  • Health Check, which is a report that enables users to see how their team is doing this iteration compared to the previous three.
  • Key drivers of engineering velocity, which help you uncover the leading indicators of high performance.
  • Work in progress, which shows users all the open pull requests with activity, in the previous 3 days.

Pinpoint

Pinpoint’s performance benchmarking tools include:

  • Issues Pipeline is the main performance benchmarking tool that presents the total number of issues in each primary work state (backlog, in progress, or closed), as well as the percentage change from the prior period. This view presents the amount of work left.
  • Another view of the Issues Pipeline menu is Demand vs. Throughput. It analyzes the backlog and work activity to answer key questions, such as whether the engineering organization’s focus is matching the demand.
  • The Issues Pipeline menu also provides a view of the current state of all work started, broken down by time spent in each more granular work state (In Review, Blocked)

Build Your Own

When you incorporate a reliable analytical tool, the metrics are based on research and analyses. Should you wish to create your system, selecting the specific metrics for accurate insights can be challenging to determine.

Locating Problems

Waydev draws attention to both engineer-related and work-related issues, while Pluralsight Flow (ex Gitprime) and Code Climate Velocity focus mostly on engineer-related problems, such as a problematic or stuck engineer. Pinpoint is oriented towards Project Management issues. A look at Waydev, Code Climate Velocity, Pinpoint, and Pluralsight Flow (ex GitPrime) reveals their differences in the detection of outliers and improper working patterns.

Engineering teams are continuously expected to deliver value to the business, but a bottleneck could ruin an entire team’s momentum during a sprint. When the teams start scaling, you begin losing visibility regarding issues. To help you overcome this issue, Waydev, Code Climate Velocity, Pinpoint, and Pluralsight Flow (ex Gitprime) came up with a new approach for the process of spotting unhealthy work patterns and outliers.

Waydev

Waydev offers a wide array of features that help you gain a better view of potential issues:

  • Work Log, which incorporates in a single dashboard all the commit and pull request related activities an engineer carried out in the selected timeframe. If you zoom in to any of the bubbles, you can also see more details about that activity. This feature can help you in identifying your engineers’ work direction and pace and adjust your decisions accordingly. waydev-vs-flow-vs-gitprime-work-log
  • Developer Summary is a feature that allows you to zoom in to a particular engineer’s detailed view. You will see where his work focus went or what is the risk level of his commits. If you scroll down, you will see a complete picture of his commit activity. For example, a high amount of churn could mean that an engineer is stuck, or incorrect specifications; in any of these cases, you might want to invite him to a one-to-one meeting and discuss the issue. waydev-vs-flow-vs-gitprime-developer-summary

Pluralsight Flow (ex Gitprime)

Pluralsight Flow’s Starter plan links issues to contributors, allowing the management to see who is responsible for something that might have gone wrong. The collaborative work reports show insights for problematic pull requests, but they are not available in the Starter plan.

To find inefficiencies, bottlenecks, or other potential issues, you need to look at:

  • Work Log, which is also Pluralsight Flow’s homepage. waydev-vs-flow-vs-gitprime-work-log2
  • Spot Check, which displays how a contributor’s performance increased or decreased over a timeframe so that you can suggest an improvement/ reward plan.waydev-vs-flow-vs-gitprime-spot-check

Code Climate Velocity

 Code Climate Velocity’s solutions to locate problems include:

  • Activity Log, which provides an overview of engineers’ output over a time frame.
  • Late Night Pushes, which signals pushes done after 8 pm weekly.

Pinpoint

Pinpoint’s way of locating problems does not include a visual way of spotting unhealthy patterns or outliers that may indicate an issue. Instead, Pinpoint provides metrics as:

  • Defect Density, which represents the number of open defects per thousand lines of code.
  • Rework Rate, which is the percentage of issues that reverted to a prior issue state.
  • Sprint Volatility, which measures the issue churn within sprints.

Build Your Own

In your engineering software, you can determine what your engineers are focused on very standard alerts. Incorporating the command line by Slack, you can obtain insights into a specific PR. Using Slack, you can also get a summary of team performance in GitHub. It may not provide the highest accuracy but an overview of the production.

Customizations

Waydev is the clear winner regarding customization options, offering Targets, custom settings, custom reports, and role access personalization, while Pluralsight Flow (ex Gitprime) and Code Climate Velocity offer a brief Targets tab and an API which enables users to build out their own reports. Pinpoint provides planning features, helping users to track their team’s progress throughout the sprint.

Waydev

Waydev offers an API system in which customers, who have the resources, can create reports. Waydev also provides a Targets feature, which you can use to translate uncovered opportunities to action by setting measurable targets within the application. Visualize and track progress to hit all your goals. The Targets feature enables users to set custom targets for their developers, teams, and organizations. You can check in on your goals and see how much progress has been made. Set event-triggered alerts and get updated when your team experiences churn spikes or efficiency drops. The alerts are enabled by the integration of Slack into Waydev.

waydev-targets

You can customize your Waydev reports using the Settings feature. The customization options include custom ignored file extensions, custom ignored commits, and ignored commits based on the number of LoC. Waydev can display your stats according to the timezone you selected in the Stats Timezone section.

Waydev provides tailored reports through the Developers Stats, Teams Stats, and Repositories Stats features. Users can create custom reports based on all Waydev metrics at multiple levels of granularity.

Waydev also offers filtering by teams, repositories, and the selected period, which can go back up to 18 months. You can opt in to receive weekly and monthly reports which contain insights about your team’s Impact, work focus, and many others. These reports can be viewed and downloaded through the Reports History tab.waydev-vs-flow-vs-gitprime-reports-history

Waydev provides Role Management and Stats Management features, which you can use to provide your users with custom access to custom features. For example, you can create a new role called ‘C-Level Executive’ and grant him access only to the Dashboard.waydev-vs-flow-vs-gitprime-role-management

The Stats Management feature enables you to grant custom permissions for users to view the Dashboard, to receive email reports, and to view repository activity by checking/ unchecking the boxes corresponding to the team/ repository.

Pluralsight Flow (ex Gitprime)

Pluralsight Flow (ex Gitprime) doesn’t have a customizable platform, but they have an API integrated into the Enterprise plan for customers that have the resources to create their reports. You can produce customized reports based on the review of coding, pull requests, and commit data. Customization includes the activation of metric specific analyses. You can also set specific goals to motivate your team on a weekly or monthly basis based on their average performances.waydev-vs-flow-vs-gitprime-targets

Code Climate Velocity

Code Climate Velocity provides several customization options, such as setting targets, customize the Health Checker, and set bilaterally agreed-upon benchmarks.

Pinpoint

Pinpoint customization options include planning, which provides insights into the sprint progress. Users can visualize and measure the health of sprints, from the planning phase through delivery, and track a cost versus performance ratio.

Build Your Own

Your build offers full customization. From the choice of metrics to analyze to rendering visual data, custom functions can help you reach your targets. This is the best option for the flexible analysis of a specific metric.

Pricing

The pricing plans of Waydev, Code Climate Velocity, Pinpoint, and Pluralsight Flow (ex Gitprime) differ significantly. Pluralsight Flow (ex Gitprime) and Code Climate Velocity restrict many of their features in their Standard plan, while Waydev offers more features for less than Pluralsight Flow’s Standard plan and Code Climate’s Essentials plan. Pinpoint’s approach to pricing is to provide a limited functionality free plan, a Business plan, and an Enterprise plan.

Waydev

Waydev has two pricing tiers:

  • The Pro plan starts at $300 per year, per engineer, and it includes all the code-level and the code review features. This plan is built for growing teams of engineers.
  • The Premium plan starts at $480 per year, per engineer, and it also includes the on-premise integrations for the data providers (GitHub Enterprise, GitLab self-hosted or Bitbucket Server) and, along with the Stats Management and the Role Management features, Single Sign-On and API access. This plan is suitable for a higher number of engineers.

Waydev wants to provide its customers with excellent quality at fair pricing, so if you wish to receive a custom offer, make sure to contact them, as they are flexible regarding users who require a high number of licenses.

Pluralsight Flow (ex Gitprime)

Pluralsight Flow (ex Gitprime) also offers two pricing plans:

  • The Standard plan, which starts at $499 per year, per engineer. This plan comes with limited functionality, missing features such as code review and collaboration insights.
  • The Plus plan, which starts at $599 per year, per engineer. It comes with the code review and collaboration insights, but it still lacks integrations with on-premise integrations for the data providers. Pluralsight Flow (ex Gitprime) offers these integrations only to enterprise-size teams.

Code Climate Velocity

Code Climate Velocity offers two pricing plans:

  • The Essentials plan, which starts at $549 per year, per engineer. This plan also comes with limited functionality, such as the lack of code review and collaboration insights, custom reports and dashboards.
  • The Professional plan starts at $649 per year, per engineer. It includes code collaboration insights, but still lacks on-prem integrations, API access, and SAML single sign-on. Code Climate Velocity also offers on-prem integrations to enterprise-size teams exclusively.

Pinpoint

Pinpoint has three plans:

  • The Free plan, which limits functionality to 9 engineers, 90 days of historical data, 50 repositories, and 5 issue projects. Support is not included in this plan.
  • The Business plan, which starts at $399 per month. It costs $40 per additional engineer per month. The historical data is limited to 12 months, and customer support is available only between 8 am-6 pm US Central time zone.
  • The Enterprise plan, which starts at $29,988 per year. It’s only available for yearly payment, and it costs $588 per additional engineer per year. You have no limit for historical data, and customer support is available 24/7.

Different approaches to Git Analytics

Waydev created a balance between code-level analytics and code review metrics, aiming to provide engineering leaders with a complete view of their team’s activity. Waydev is also more flexible regarding:

  • Pricing, offering everything Pluralsight Flow (ex Gitprime) and Code Climate Velocity included in their $599 Plus plan, respectively $649 Professional plan, at a $300 starter plan.
  • Customizations, providing the Stats Management and the Role Management features, which are of great use for larger organizations.

Pluralsight Flow (ex Gitprime) offers an individual performance view of the team, which is oriented towards hands-on engineering managers. Code Climate Velocity focuses rather on code collaboration stats, and Pinpoint focuses on Project Management metrics.

To determine value, it requires a look at the cost. Code Climate Velocity, Pinpoint, and Pluralsight Flow (ex GitPrime) are well-recognized, but limit functionality across lower-tier software. Waydev provides a multitude of functionalities and is considered more affordable. Management can benefit from Waydev’s flexibility across all levels. For the best value, determine which platform offers the best features for your professional and product requirements.

When selecting an analytical tool for your team requirements, look at Gitprime competitors, Code Climate Velocity competitors, Pinpoint competitors, and determine the metrics, the value, and the functionality. Consider dynamic and innovative analytical software such as Waydev to incorporate into your analytical processes.

Both products offer a trial. You can sign up for Waydev’s here.

Waydev customers reviews

 

Myles Henaghan, CTO @Accordo Group Ltd.: Now that we can measure, we can manage.

The app immediately cuts to the chase and gives you a snapshot of how the team is performing.

We are very happy with Waydev and the team behind it. For years, I have struggled to find an unbiased, low friction way to keep a pulse on developer productivity.

Waydev closes off a big piece of this puzzle. Used in conjunction with other information, we have a 360-degree view and understanding of how the team is performing, as well as a benchmark for good > great.”

 

Jorge del Rio, CTO @Wiggot: “Very good to evaluate your team’s performance. The feature to calculate the performance of the team versus previous sprints are awesome. Also, you can easily identify if the role of your engineers is according to the job done.

I was trying to understand how my team was performing during the development of new products so I can improve my estimates. Usually refactoring and bug fixing of previous features slow down new ones. With Waydev I was able to identify why the new development was delayed and how much time my engineers spent on the rework of old code.”

 

David Camargo, VP of Engineering @Instaleap: “Good tool to understand your team dynamics. Waydev has proved to be a very useful tool for me to understand how my team is performing. I use it as part of the feedback on 1-1 meetings, and it helps me to provide feedback valuable to developers and ask questions about certain trends shown on their code. It’s really easy to use and I practically don’t need to do anything to use it.”

Switching from Pluralsight Flow, Gitprime to Waydev?

Waydev and Pluralsight Flow, ex Gitprime are two of the best Git Analytics tools in the market. While Pluralsight Flow, ex Gitprime carries a renowned reputation in the software development field, it is not the best Git Analytics tool. Waydev integrates with all the major git providers and provides three layers of data: code-level insights, code review metrics, and a data-driven approach to engineering project management.

When choosing Pluralsight Flow, ex Gitprime there are things you should keep in mind. Despite its wide range of features and tools it offers, it’s not the best choice for enterprise-level companies because it lacks important features such as role-based access control, integrations with Microsoft Azure DevOps, and a dedicated success manager. Waydev provides a highly customizable role-based access control, it integrates with Microsoft Azure DevOps and provides its customers with a dedicated success manager.