hadoop


pig - read/write data from remote hbase server


I want to read/write data from hbase remote server from pig script. We are using Hortonworks HDP 2.5
Following is scenario.
We have two clusters, one for Hive and one for Hbase. We have access to edge node which is part of Hive cluster.
Our code (MapReduce jobs & Pig script) will be executed on Hive cluster.
As part of requirement, we have to also read/write data from Hbase tables.
We found one solution on net but it's not working.
http://grokbase.com/t/cloudera/cdh-user/137at5cg72/pig-stores-into-remote-hbase
This solution suggests to register zookeeper quorum of hbase server inside our pig script. But the syntax is not working.
set hbase.zookeeper.quorum '108.168.251.xxx-static.reverse.softlayer.com<http://108.168.251.xxx-static.reverse.softlayer.com:8020/hbase>'
...
STORE raw_rec INTO 'hbase://my_table<http://108.168.251.xxx-static.reverse.softlayer.com:8020/hbase>' USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('score:val');
But this is not working. Getting error as only alphanumeric characters are allowed in namespace (< > sign not allowed)
Please let us know if there is any way to read/write data from remote hbase cluster inside pig using default org.apache.pig.backend.hadoop.hbase.hbasestorage
Thanks in Advance!!!

Related Links

Pass table names from a file to oozie workflow
How to convert epoch time stamp to PST date in hive
Does sqoop spill temporary data to disk
Understanding number of map and reduce tasks in Hadoop MapReduce
What is meant by “Max Application Master Resources” in the Resource Manager for the Cluster?
Webhcat show database error missing operand
Can the teradata connector sqoop sequencefile format overcome delimiter issues?
Hive throws error after sqooping data
Installation not responding
sqoop import-all-tables failure: org.apache.hadoop.ipc.RemoteException No lease
Unable to start apache phoenix over hbase
Redirecting embedded Hive from /var and /tmp directories
Can sqoop run without hadoop?
Impala Server is dead and pid file exists
Hadoop: Exception in thread “main” java.lang.ClassNotFoundException: WordCount2
Selecting Data from mulitple tables in Hive

Categories

HOME
asp.net-identity
f#
identityserver4
copy
apt-get
configuration
compiler-errors
jsessionid
bootstrap-selectpicker
libreoffice
box
android-bluetooth
autofac
struts2-jquery
drag
eps
executable
marketplace
luci
tapi
imp
watchservice
embed
jmeter-plugins
jpos
centroid
wso2cep
fat-free-framework
cloudinary
spring-websocket
capstone
jformattedtextfield
google-crawlers
outlook-vba
gradient-descent
msal
flags
linechart
caldroid
symfony-process
linear
gradle-tooling-api
msysgit
htc
mashery
g-wan
masm32
reactivex
glumpy
kie-workbench
logstash-jdbc
mit-scheme
ocsp
data-fitting
sql-server-2016-express
oracle-policy-automation
pypyodbc
flotr2
xlform
docklight
storage-duration
wgs84
sample-data
nominatim
rdotnet
oboe.js
voting
xsb
omap
antiforgerytoken
setattribute
mklink
sendto
monk
xsltforms
sonata-media-bundle
jxta
android-lru-cache
prudentia
memoization
hla
xcode4.2
route-me
chromeless
uptime
html5-apps
square-cube
dynamic-usercontrols
wpf-4.0
ad-hoc-distribution
xml-dtd
b-method
ember-router
ondraw
azure-role-environment
textboxlist
retain
replay
iequalitycomparer
stsadm
variable-names

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App