hadoop


pig - read/write data from remote hbase server


I want to read/write data from hbase remote server from pig script. We are using Hortonworks HDP 2.5
Following is scenario.
We have two clusters, one for Hive and one for Hbase. We have access to edge node which is part of Hive cluster.
Our code (MapReduce jobs & Pig script) will be executed on Hive cluster.
As part of requirement, we have to also read/write data from Hbase tables.
We found one solution on net but it's not working.
http://grokbase.com/t/cloudera/cdh-user/137at5cg72/pig-stores-into-remote-hbase
This solution suggests to register zookeeper quorum of hbase server inside our pig script. But the syntax is not working.
set hbase.zookeeper.quorum '108.168.251.xxx-static.reverse.softlayer.com<http://108.168.251.xxx-static.reverse.softlayer.com:8020/hbase>'
...
STORE raw_rec INTO 'hbase://my_table<http://108.168.251.xxx-static.reverse.softlayer.com:8020/hbase>' USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('score:val');
But this is not working. Getting error as only alphanumeric characters are allowed in namespace (< > sign not allowed)
Please let us know if there is any way to read/write data from remote hbase cluster inside pig using default org.apache.pig.backend.hadoop.hbase.hbasestorage
Thanks in Advance!!!

Related Links

Percentile calculation in Pig Latin
hadoop2 build hdfs without yarn and mapreduce
Where are the start/stop hadoop hdfs/mapred scripts on CDH5
File/Command not found while running “hadoop version” command. Hadoop installation
Spark YARN client job from host with hostname unknown to cluster?
correlation calculation on hadoop?
Running hadoop jobs over snappy compressed column familes
hadoop mapreduce job fails as it checking for jars in the HDFS (only in hbase jobs)
Mahout Clustering with one dim K-means [duplicate]
Using gzip as a reducer produces corrupt data
“Doesn't exist in RM” backend error in Pig
Is there a way to access hive metastore tables from HCATALOG?
yarn [hadoop 2.2] where is the location mapper or reducer log outputed?
How to import an AvroKeyValueOutputFormat file into hive?
Modifying oozie code
Hadoop sequential data access

Categories

HOME
amazon-s3
xaml
dicom
rtmp
spring-roo
jsonschema
wikipedia
gluon
wso2is
spi
freebsd
apache-spark-sql
dbus
gcov
signature
vulkan
jscrollpane
partitioning
factory-girl
api-design
javers
garmin
revitpythonshell
ormlite-servicestack
c-strings
montecarlo
mediator
google-oauth2
italic
parallax
android-button
memorystream
webfocus
sql-server-2014-express
valueinjecter
tweenmax
webcenter
server-sent-events
folly
powerbuilder-conversion
windows-scripting
atlassian-bitbucketserver
polymer-cli
tabview
httpexception
karnaugh-map
requirements-management
scoring
ganglia
dump
android-identifiers
hipi
iseries-navigator
zenity
agile-processes
gwt-material-design
cakephp-2.3
hapi.js
statistics-bootstrap
ckcontainer
vimeo-ios
clientid
uikeyboard
sample-data
ironmq
many-to-one
oboe.js
getuikit
information-schema
globus-toolkit
email-spam
jqgrid-php
sshj
libavcodec
appstore-sandbox
modx-evolution
sysadmin
datasift-python
zephir
kmz
mosek
loadlibrary
dependency-walker
rc-shell
libavg
mysql-backup
adaboost
molehill
nsinvocation
proxy-classes
semantic-zoom
httpcontext.cache
etrade-api
cluetip
winamp
jboss-cache
indextank
crc-cards
code-statistics

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App