Installing Apache Atlas and it’s awkward

Atlas is a scalable and extensible set of core foundational governance services – enabling enterprises to effectively and efficiently meet their compliance requirements within Hadoop and allows integration with the whole enterprise data ecosystem.

Apache Atlas provides open metadata management and governance capabilities for organizations to build a catalog of their data assets, classify and govern these assets and provide collaboration capabilities around these data assets for data scientists, analysts and the data governance team.

– Apache Atlas

Few days ago, I need to install Apache Atlas for my work. Followed the official document for the build and installation but it did not work with really awkward errors.

Build instruction: https://atlas.apache.org/#/BuildInstallation

Btw, Maven is needed, if you don’t know, to install it, you need Java. In short:

sudo apt-get update
sudo apt-get install default-jre
sudo apt-get install openjdk-8-jdk

cd /usr/local
sudo wget https://www-eu.apache.org/dist/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz
sudo tar xzf apache-maven-3.6.3-bin.tar.gz
sudo ln -s apache-maven-3.6.3 apache-maven

export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
export M2_HOME=/usr/local/apache-maven
export MAVEN_HOME=/usr/local/apache-maven
export PATH=${M2_HOME}/bin:${PATH}

When I execute this command:

mvn clean -DskipTests install

It outputs this error:

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-checkstyle-plugin:2.9.1:check (checkstyle-check) on project apache-atlas: Execution checkstyle-check of goal org.apache.maven.plugins:maven-checkstyle-plugin:2.9.1:check failed: Plugin org.apache.maven.plugins:maven-checkstyle-plugin:2.9.1 or one of its dependencies could not be resolved: Failure to find org.apache.atlas:atlas-buildtools:jar:1.0 in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]

Look at the error: Failure to find org.apache.atlas:atlas-buildtools:jar:1.0, go to the link provided: https://repo.maven.apache.org/maven2/org/apache/atlas/atlas-buildtools/ and see what we have:

org/apache/atlas/atlas-buildtools

../
0.8-incubating/                                   2017-03-17 06:38         -      
0.8.1/                                            2017-08-29 16:22         -      
maven-metadata.xml                                2017-08-29 17:05       379      
maven-metadata.xml.md5                            2017-08-29 17:05        32      
maven-metadata.xml.sha1                           2017-08-29 17:05        40      

There is no 1.0 version?! WTH?!

Let’s see what we have on Google for atlas-buildtools:

Google search results

I went through each and every result in 171,000 pages and none of them has the 1.0 version. Just kidding, just looked at first 2. WTH Apache?!

So I think that 0.8.1 version would work, but why does it use 1.0 version? It’s maven, so it must be stated in the pom.xml file. Let’s open it up and see.

We have 2 places with this:

<dependency>
   <groupId>org.apache.atlas</groupId>
   <artifactId>atlas-buildtools</artifactId>
   <version>${project.version}</version>
</dependency>

I changed both of them to:

<dependency>
   <groupId>org.apache.atlas</groupId>
   <artifactId>atlas-buildtools</artifactId>
   <version>0.8.1</version>
</dependency>

Run the command again and it works. Next, just follow the instruction https://atlas.apache.org/#/Installation:

mvn clean -DskipTests package -Pdist,embedded-hbase-solr

cd distro/target
tar -xzvf apache-atlas-{project.version}-server.tar.gz
cd apache-atlas-{project.version}

export MANAGE_LOCAL_HBASE=true
export MANAGE_LOCAL_SOLR=true
python3 bin/atlas_start.py

Now, Atlas is ready, default username/password is admin/admin!