Apache Atlas Overview
Apache Atlas framework is an extensible set of core
foundational governance services – enabling enterprises to effectively and
efficiently meet their compliance requirements within Hadoop and allows
integration with the whole enterprise data ecosystem.
This will provide true visibility in Hadoop by using both a prescriptive
and forensic model, along with technical and operational audit as well as
lineage enriched by business taxonomical metadata. It also enables any
metadata consumer to work inter-operably without discrete interfaces to
each other – the metadata store is common.
The metadata veracity is maintained by leveraging Apache Ranger to prevent
non-authorized access paths to data at runtime.
Security is both role based (RBAC) and attribute based (ABAC).
NOTE
Apache Atlas allows contributions via pull requests (PRs) on GitHub. Alternatively, use this to submit changes for review using the Review Board.
Also create a atlas jira to go along with the review and mention it in the pull request/review board review.
Building Atlas in Docker
Instructions to build and run atlas in docker: dev-support/atlas-docker/README.md
Regular Build Process
-
Get Atlas sources to your local directory, for example with following commands
cd <your-local-directory>
git clone https://github.com/apache/atlas.git
cd atlas
# Checkout the branch or tag you would like to build
# to checkout a branch
git checkout <branch>
# to checkout a tag
git checkout tags/<tag>
-
Execute the following commands to build Apache Atlas
export MAVEN_OPTS="-Xms2g -Xmx2g"
-
Apache Atlas supports building with Java 8, Java 11, and Java 17. Set the appropriate JAVA_HOME and MAVEN_OPTS before building.
-
For Java 8 / Java 11:
export MAVEN_OPTS="-Xms2g -Xmx2g"
-
For Java 17:
export MAVEN_OPTS="--add-opens=java.base/java.lang=ALL-UNNAMED \
--add-opens=java.base/java.lang.reflect=ALL-UNNAMED \
--add-opens=java.base/java.nio=ALL-UNNAMED \
--add-opens=java.base/java.net=ALL-UNNAMED \
-Xms2g -Xmx2g"
-
After setting the correct MAVEN_OPTS, run:
mvn clean install
mvn clean package -Pdist
-
After above build commands successfully complete, you should see the following files
distro/target/apache-atlas-<version>-bin.tar.gz
distro/target/apache-atlas-<version>-hbase-hook.tar.gz
distro/target/apache-atlas-<version>-hive-hook.tar.gz
distro/target/apache-atlas-<version>-impala-hook.tar.gz
distro/target/apache-atlas-<version>-kafka-hook.tar.gz
distro/target/apache-atlas-<version>-server.tar.gz
distro/target/apache-atlas-<version>-sources.tar.gz
distro/target/apache-atlas-<version>-sqoop-hook.tar.gz
distro/target/apache-atlas-<version>-storm-hook.tar.gz
distro/target/apache-atlas-<version>-falcon-hook.tar.gz
distro/target/apache-atlas-<version>-couchbase-hook.tar.gz
-
For more details on installing and running Apache Atlas, please refer to https://atlas.apache.org/#/Installation
评论