Skill Assessments | 14% increase in User Engagement | 11% growth in user count

I led the design for a new feature request, skill assessment for Educative.

My Role

Project Tags

Visual Design
Competitor Analysis
Design Audit
Interaction Design

Credits

Team

Special thanks to Muhammad Owais (product manager) for extensive documentation and helping with competiter analysis to finalise the features of this project.

1 UX Designer
1 Product Manager
3 Front-end Engineers
1 Senior Software Engineer

About Educative

Educative is an interactive text-based online learning platform for developers. The users who study courses are called Learners.

The courses offered help developers for interview preparation and to grow their skillset. 

Learners do not have to download any software to run their code. All the actions take place on the browser.

Users can become authors by creating courses and learners by studying courses available on the platform.

Fig. A screenshot of a course lesson on Educative. The left navigation bar helps user to navigate to different lessons. The content area consists of different widgets that helps display information to optimize learning. For example, the coding widget at the bottom has a “Run” button so the user can see what is the output of the code written.

What is a Skill assessment?

Skill assessment tests user on a specific topic to evaluate the user’s expertise. For example, Figma Fundamentals will evaluate the expertise of the test taker in Figma software. Based on the test performance, a user will be categorized as a beginner, proficient, or an expert. Users will receive feedback on their skill gaps and recommendations on how to close that gap.

Problem

Given 400 courses in the platform, users are unaware which courses they should take that are relevant to them to grow or polish their skills.

Goals

Business Goals

Increase the number of free trials, and annual or monthly subscriptions

Give Educative a better market position against its competitors

Increase product engagement to retain paid users

User Goals

Take multiple tech skill tests and receive feedback on study goals

Measure individual skills in a given technology, identifies gaps, and recommend courses to close that gaps

Targeted User Personas

We wanted everyone who visits our product to try skill assessments so they can learn more about our product and courses they should focus to increase their skills.

The personas can be categorized into 2 groups

1. Non-paying users

  • Free trial users and Edpresso, blog, and Marketing pages visitors

  • Logged out users (Skill assessments can be taken by logged out users)

2. Paying users

  • Annual and monthly subscribers

  • course buyers

Competitor Analysis

The product manager and I carefully examined how our competitors had designed the skill assessment feature. This exercise helped us what features to include that would help Educative have a better market position against its competitors.

The Competitors

The above platforms

Use adaptive testing in assessments

Share proof of their skill set/certificate on LinkedIn and resumes

Allows the users to share scores or badges on social media

Fig. Assessment results page of datacamp where the level, percentile, and recommendations based on the assessment performance are provided.

Fig. Assessment result page of pluralsight where the skill level, percentile, course recommendations,, user’s strengths, and user’s weaknesses are provided.

MVP User flow of Skill Assessments

The senior content team members (who prepared questions and times for the assessments), product manager, development team lead, and I brainstormed and shortlisted ideas regarding what and how to include content in our skill assessment feature. We made decisions based on time constraints as we wanted to take this live in 3 months.

Brainstorming and Early Decisions

Fig. Some Decisions we made early on when brainstorming and then shortlisting ideas based on constraints

Concept Visualization / Low-fi Design

After meeting with the stakeholders, I sketched the layout for each page and shared with the stakeholders.

Requirements For MVP And Design Decisions

Assessment Homepage

We needed a page where we could

Tell the user what are skill assessments

show the list of skill assessments a user could take

I explored ways how the UI of the skill assessment tile should be. We wanted the skill assessment tile to be different from the path and course tiles because we wanted to brand skill assessments as a separate product of the platform

Skill Assessment Tile

Path Tile

Course Tile

Design Iterations and Decisions for Skill Assessment tile

Iteration

Tile too similar to the course tile that may cause confusion to the users.

Iteration

Title of skill assessment upfront 

Description not valuable since any useful detail cannot be covered in a sentence

Iteration

Title of skill assessment upfront 

Different dimensions and arrangement of UI elements than that of the course tile

The complete tile is clickable in accordance with UX Fitts’ law.

Removed time since it would be same for every assessment

Assessment Tile Visual Design Breakdown

Final Assessment Homepage

Since Educative is a text based interactive learning platform, we had numerous requests from the users to have a dark mode so there is less strain on the eyes. The design team created a palette for dark mode.

Assessment Homepage - Dark mode

Individual Assessment page

The senior content team members (who prepared questions and times for the assessments), the product manager, and I discussed the requirements on the individual assessment page and the assessment’s result page.  The assessment page will include

the CTA “Start Assessment” and  Skill assessment details such as duration and attempts

Assessment description

Skill Assessment Badges

Topics covered on the assessment

Courses to prepare to score well on the assessment

Multiple UI design iterations were tested for the individual Assessment page and the Result page. The goal was to present information that is easy to absorb. 

Iteration

topics covered section is not easy to read

Too much visual weight was given to the badge being at the center

Iteration

Topics covered easy to read

A lot of empty space on the right of “Assessment Content” (or topics covered) section so we did more iterations.

Iteration

Topics covered section is easy to read and better use of space compared with the previous iteration

“Why take the assessment” section was redundant since it would be same for every assessment 

From a marketing point of view and in order to give the user a sense of accomplishment, the badge did not seem prominent in this iteration

Iteration

 - Finalised Design for individual assessment homepage

Individual assessment homepage - Dark Mode

Assessment’s Result page

This page will be shown to the users when they have completed the assessment. The result page would include

The user's skill level (beginner, proficient, expert)

What percentage of the assessment was passed

Skill assessment badge and ability to share it on Linkedin, facebook, and twitter

Recommended courses 

Scores of the user’s previous attempts

Iteration

 “Recommendations” section should come before “My Attempts” section as recommendations are more important.

UI color not consistent with the individual assessment homepage at the top

Iteration

Alignment issues that with the center aligning of UI elements

UI color consistent with the individual assessment homepage

Iteration

 - Finalised Design for Assessment’s Result page

Case where the user earned a badge for getting a “Proficient” or “Expert” Skillscore

Assessment Result page - Dark mode

Problems with Existing Assessment’s UI

A few of Educative’s courses have assessments that a user may take to test their learning. Only 52% of the users who started an assessment completed it. The product manager and I decided that we should redesign the UI of assessments because it plays a crucial role in the success of the new feature.

New Assessment UI and Design Decisions

Answer Selected State

Case where the time for the assessment is over

Fig. The above modal appears when the time for the assessment is over before the user could complete the assessment. 

New Assessment UI - Dark Mode

Impact

After just 2 weeks of the skill assessments launch, an increase of 14% of the users who attempted the assessment and completed it

78% of the users who completed the assessment opened the course homepages of their personalised course recommendations. 21% of logged out users signed up for educative.

Personal Takeaways

Learnt to teach others how to give meaningful feedback so the changes made in the next iteration are highly impactful

Improved cross communication because I worked with multiple teams in this project including business, content, and product team

Gained understanding of how to balance UI elements on the screen for pleasant viewing experience

Next Project

Optimizing the experience of GitHub Student Pack users

Liking what you see? Let’s chat. I can talk about design all day!
Email: usmansamee5@gmail.com