Atlas is a scalable and extensible set of core foundational governance services – enabling enterprises to effectively and efficiently meet their compliance requirements within Hadoop and allows integration with the whole enterprise data ecosystem.
Apache Atlas provides open metadata management and governance capabilities for organizations to build a catalog of their data assets, classify and govern these assets and provide collaboration capabilities around these data assets for data scientists, analysts and the data governance team.
– Apache Atlas
Few days ago, I need to install Apache Atlas for my work. Followed the official document for the build and installation but it did not work with really awkward errors.
Build instruction: https://atlas.apache.org/#/BuildInstallation
Btw, Maven is needed, if you don’t know, to install it, you need Java. In short:
sudo apt-get update
sudo apt-get install default-jre
sudo apt-get install openjdk-8-jdk
cd /usr/local
sudo wget https://www-eu.apache.org/dist/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz
sudo tar xzf apache-maven-3.6.3-bin.tar.gz
sudo ln -s apache-maven-3.6.3 apache-maven
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
export M2_HOME=/usr/local/apache-maven
export MAVEN_HOME=/usr/local/apache-maven
export PATH=${M2_HOME}/bin:${PATH}
When I execute this command:
mvn clean -DskipTests install
It outputs this error:
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-checkstyle-plugin:2.9.1:check (checkstyle-check) on project apache-atlas: Execution checkstyle-check of goal org.apache.maven.plugins:maven-checkstyle-plugin:2.9.1:check failed: Plugin org.apache.maven.plugins:maven-checkstyle-plugin:2.9.1 or one of its dependencies could not be resolved: Failure to find org.apache.atlas:atlas-buildtools:jar:1.0 in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]
Look at the error: Failure to find org.apache.atlas:atlas-buildtools:jar:1.0, go to the link provided: https://repo.maven.apache.org/maven2/org/apache/atlas/atlas-buildtools/ and see what we have:
org/apache/atlas/atlas-buildtools
../
0.8-incubating/ 2017-03-17 06:38 -
0.8.1/ 2017-08-29 16:22 -
maven-metadata.xml 2017-08-29 17:05 379
maven-metadata.xml.md5 2017-08-29 17:05 32
maven-metadata.xml.sha1 2017-08-29 17:05 40
There is no 1.0 version?! WTH?!
Let’s see what we have on Google for atlas-buildtools:
I went through each and every result in 171,000 pages and none of them has the 1.0 version. Just kidding, just looked at first 2. WTH Apache?!
So I think that 0.8.1 version would work, but why does it use 1.0 version? It’s maven, so it must be stated in the pom.xml file. Let’s open it up and see.
We have 2 places with this:
<dependency>
<groupId>org.apache.atlas</groupId>
<artifactId>atlas-buildtools</artifactId>
<version>${project.version}</version>
</dependency>
I changed both of them to:
<dependency>
<groupId>org.apache.atlas</groupId>
<artifactId>atlas-buildtools</artifactId>
<version>0.8.1</version>
</dependency>
Run the command again and it works. Next, just follow the instruction https://atlas.apache.org/#/Installation:
mvn clean -DskipTests package -Pdist,embedded-hbase-solr
cd distro/target
tar -xzvf apache-atlas-{project.version}-server.tar.gz
cd apache-atlas-{project.version}
export MANAGE_LOCAL_HBASE=true
export MANAGE_LOCAL_SOLR=true
python3 bin/atlas_start.py
Now, Atlas is ready, default username/password is admin/admin!