Home

Auto Actions

Output schema:

schema:
type: array
items:
type: string
Returns list of active and inactive auto actions

/autoactions

No parameters

curl -X GET "http://myserver.com:3000/api/v1/autoactions" -H  "accept: application/json"  "Authorization: JWT token"
[{"enabled":false,"policy_name":"AutoAction2","policy_id":10,"instance_id":"5346557784540652874",
"name_by_user":"Long running YARN application Automation","description_by_user":"","created_by":"admin","last_edited_by":"admin","created_at":1551125124967,"updated_at":1551861204577,"rules":[{"SAME":[{"scope":"apps","metric":"elapsedTime","compare":">","state":"*","type":"mapreduce","value":10000}]}],"actions":[{"action":"send_email","to":["ravi@unraveldata.com"],"to_owner":false},{"action":"kill_app"}],"cluster_mode":0,"cluster_list":[],"cluster_transform":"","queue_mode":0,"queue_list":[],"queue_transform":"","user_mode":2,"user_list":["user7"],"user_transform":"","app_mode":2,"app_list":["QuasiMonteCarlo"],"app_transform":"","sustain_mode":0,"sustain_time":0,"time_mode":1,"start_hour":13,"start_min":59,"end_hour":13,"end_min":59,"dt_zone":"America/Los_Angeles","broker_mode":0,"broker_list":[],"broker_transform":"","topic_mode":0,"topic_list":[],"topic_transform":""},{"enabled":false,"policy_name":"AutoAction2","policy_id":10,"instance_id":"7944134729015777055",
"name_by_user":"Long running Hive query Automation","description_by_user":"","created_by":"admin","last_edited_by":"admin","created_at":1551125155192,"updated_at":1551787684684,"rules":[{"SAME":[{"scope":"apps","metric":"duration","compare":">=","state":"*","type":"hive","value":100}]}],"actions":[{"action":"http_post","urls":["https://unraveldata.slack.com/messages/CA2RX1M35/"]}],"cluster_mode":0,"cluster_list":[],"cluster_transform":"","queue_mode":0,"queue_list":[],"queue_transform":"","user_mode":0,"user_list":[],"user_transform":"","app_mode":0,"app_list":[],"app_transform":"","sustain_mode":0,"sustain_time":0,"time_mode":0,"start_hour":12,"start_min":5,"end_hour":12,"end_min":5,"dt_zone":"America/Los_Angeles","broker_mode":0,"broker_list":[],"broker_transform":"","topic_mode":0,"topic_list":[],"topic_transform":""},{"enabled":false,"policy_name":"AutoAction2","policy_id":10,"instance_id":"2556543518905386312",
"name_by_user":"Resource contention in cluster allocated memory Automation","description_by_user":"","created_by":"admin","last_edited_by":"admin","created_at":1551125186605,"updated_at":1551787687869,"rules":[{"SAME":[{"scope":"clusters","metric":"allocatedMB","compare":">","value":1024},{"scope":"clusters","metric":"appCount","compare":">","state":"*","value":2}]}],"actions":[{"action":"send_email","to":["ravi@unraveldata.com"],"to_owner":false}],"cluster_mode":1,"cluster_list":[],"cluster_transform":"","queue_mode":0,"queue_list":[],"queue_transform":"","user_mode":2,"user_list":["user1"],"user_transform":"","app_mode":0,"app_list":[],"app_transform":"","sustain_mode":0,"sustain_time":0,"time_mode":0,"start_hour":12,"start_min":6,"end_hour":12,"end_min":6,"dt_zone":"America/Los_Angeles","broker_mode":0,"broker_list":[],"broker_transform":"","topic_mode":0,"topic_list":[],"topic_transform":""},{"enabled":false,"policy_name":"AutoAction2","policy_id":10,"instance_id":"8761136669870544897",
"name_by_user":"Resource contention in cluster allocated vcores Automation","description_by_user":"","created_by":"admin","last_edited_by":"admin","created_at":1551125217281,"updated_at":1551787691083,"rules":[{"SAME":[{"scope":"clusters","metric":"allocatedVCores","compare":">=","value":2},{"scope":"clusters","metric":"appCount","compare":">=","state":"*","value":2}]}],"actions":[{"action":"send_email","to":["ravi@unraveldata.com"],"to_owner":false}],"cluster_mode":1,"cluster_list":[],"cluster_transform":"","queue_mode":0,"queue_list":[],"queue_transform":"","user_mode":2,"user_list":["user2"],"user_transform":"","app_mode":0,"app_list":[],"app_transform":"","sustain_mode":0,"sustain_time":0,"time_mode":0,"start_hour":12,"start_min":6,"end_hour":12,"end_min":6,"dt_zone":"America/Los_Angeles","broker_mode":0,"broker_list":[],"broker_transform":"","topic_mode":0,"topic_list":[],"topic_transform":""}]
Returns list of violations

/autoactions/violations

Parameters:

  • from: starting date of date range. Format YYYY-MM-DD

  • to: ending date of date range. Format YYYY-MM-DD

  • limit: maximum number of violations to return

curl -X GET "http://myserver.com:3000/api/v1/autoactions/recent_violations?from=2019-03-01&to=2019-03-06&limit=10" -H  "accept: application/json" -H  "Authorization: JWT token"
Returns list of auto action metrics

/autoactions/metrics

No parameters

curl -X GET "http://devcdh513k.unraveldata.com:3000/api/v1/autoactions/metrics" -H  "accept: application/json" -H  "Authorization: JWT TOKEN"
{   "appCount","elapsedTime","allocatedMB","allocatedVCores","runningContainers","memorySeconds","vcoreSeconds","jobCount","elapsedAppTime","mapsTotal","mapsCompleted","reducesTotal","reducesCompleted","mapsPending","mapsRunning","reducesPending","reducesRunning","newReduceAttempts","runningReduceAttempts","failedReduceAttempts","killedReduceAttempts","successfulReduceAttempts","newMapAttempts","runningMapAttempts","failedMapAttempts","killedMapAttempts","successfulMapAttempts","badId","connection","ioError","wrongLength","wrongMap","wrongReduce","fileBytesRead","fileBytesWritten","fileReadOps","fileLargeReadOps","fileWriteOps","hdfsBytesRead","hdfsBytesWritten","hdfsReadOps","hdfsLargeReadOps","hdfsWriteOps","mapInputRecords","mapOutputRecords","mapOutputBytes","mapOutputMaterializedBytes","splitRawBytes","combineInputRecords","combineOutputRecords","reduceInputGroups","reduceShuffleBytes","reduceInputRecords","reduceOutputRecords","spilledRecords","shuffledMaps","failedShuffle","mergedMapOutputs","gcTimeMillis","cpuMilliseconds","physicalMemoryBytes","virtualMemoryBytes","committedHeapBytes","totalLaunchedMaps","totalLaunchedReduces","dataLocalMaps","slotsMillisMaps","slotsMillisReduces","millisMaps","millisReduces","vcoresMillisMaps","vcoresMillisReduces","mbMillisMaps","mbMillisReduces","bytesRead","bytesWritten","duration","totalDfsBytesRead","totalDfsBytesWritten","inputRecords","outputRecords","outputToInputRecordsRatio","totalJoinInputRowCount","totalJoinOutputRowCount","inputPartitions","outputPartitions","joinInputRowCount","joinOutputRowCount","joinOutputToInputRowRatio"
}]
In this section: