How to run Azure Data Factory pipeline on Java Eclipse - java

I am doing a project to integrate ADF pipeline with Java project. Is there any possible way to run the ADF pipeline remotely using Java?
I am a newcomer to this field and I didn't find any valuable articles regarding the question. Pls let me know if there is any possible solution to do so.

You may use the REST API to trigger pipeline runs from external applications, including Java. It is a POST request, and you may find details here:
https://learn.microsoft.com/en-us/rest/api/datafactory/pipelines/create-run?tabs=HTTP
Alternatively, there is a Data Factory client library for Java. It appears to be in beta, but provides the functionality you are looking for:
https://learn.microsoft.com/en-us/java/api/overview/azure/resourcemanager-datafactory-readme?view=azure-java-preview

Related

Java way to Azure CLI and KubeCTL

I have a very basic REST API that provides some information, which was written with JAX-RS.
Now I want to implement some azure cli commands, like az acr repository list as well as kubectl.
I found the Azure Java SDK, and read its API reference, but I couldn't figure out how I will basically list the repositories.
Kubernetes example is much better, but I am stuck with Azure Container Registry.
Basically I am asking a code sample (reference), or tutorial, or guidance.
Whatever my experience of using Azure docs, it's little hard to find API doc which will work for you and you may found some discrepancies between docs like one of API via cli vs sdk behaves different.
As per my work with various clouds, most of the cloud clients are inclined to use python SDKs. 3-4 ago, I had used java for openstack, now python. For VCloud, used java but now moving to python, in fact they stopped to provide java sdk.
Hope you have got some pointers.

How to use Oracle Responsys with Java Application

In my Java Application I want to use Oracle Responsys to trigger individual email in response to some activity detected by my web site
Oracle Responsys is completely new for me and not able find out where to start.
I got SOAP API Developer’s Guide — Standard documentation, and trying to figure out myself. But seems to be I am not understanding the core concept of how to integrate Oracle Responsys in my application.
Please help on how to integrate Oracle Responsys into my web application? I am not able to find any Java SDK for Oracle Responsys, is there one available? If available from where I can get it?
I am not understanding the core concept of how to integrate Oracle Responsys in my application.
The "core concept" is that your application sends requests to the Responsys server's API over HTTP / HTTPS. Your application can (in theory) do this directly by crafting HTTP requests with the correct parameters / payloads / etc, and then parsing the results. Alternatively, it can use either a generic framework (such as JAX-WS), or a specific client library to do most of the tedious stuff for you.
I am not able to find any Java SDK for Oracle Responsys, is there one available.
Responsys provides both REST and SOAP based APIs, but at this time they don't appear to provide any (official) Java client-side libraries for either API.
I did find some 3rd-party client libraries on Github. Rather than listing them, I suggest that you Google for responsys api github and start trawling the search results.
Questions that ask for recommendations on StackOverflow, are off topic, so I'm assuming that you are not asking for one. But, you will need to do your own assessment of the completeness and fitness for purpose of the various library alternatives.

Integrating swagger api to Java application

I've been googling for some time on how to use Swagger in Java application but I did not find any helpful resources so I'm asking here. I know it's quite general question but I need to find some kind of starting point to be able to get next steps.
So, I have JavaEE application which gets some JSON through http, parses it and does sth with this data. I was given a totally new API specification made in Swagger (1.2 to be exact). The problem is that I do not know how to stick it together with my application.
Should I load JSON file with spec to my application and then do sth with it?
Should I use swagger-codegen to generate Java client code and then use it someway in my application?
And what is the 3rd step? How to invoke http requests with this Swagger api?
In general, the question is about integrating Swagger json api to Java application. I would be very grateful for any hints or links to tutorial or sth:)
Given that you've the API specification in Swagger (1.2), you can use Swagger Codegen to generate the Java API client and use it in your JavaEE application.
Here is one way to generate the Java API client online without installing swagger-codegen locally:
https://github.com/swagger-api/swagger-codegen#online-generators

How to get Java to access Cassandra 1.0.10

Can anyone recommend a good way to create scripts in java that will work with an older Cassandra 1.0.10 database? I'm having trouble finding stuff online. Is thrift a type of driver?
Thanks!
Apache Thrift is way to connect to the Cassandra RPC server 1).
In the Cassandra source three there is a file /interface/cassandra.thrift which is an interface description file (IDL) that can be fed to the Apache Thrift compiler in order to generate Java code. By means of this Java code you will be able to access Cassandra. The whole process is described in more detail in the Cassandra wiki.
However, it is recommended to use a more high-level client library instead, because the raw Cassandra API is quite complex. You'll find the existing libraries, such as Hector, much more handy for your task.
1) Some more details about Thrift can be found in this answer.

Creating a program to manage Amazon EC2 instances

I am attempting to create a program that can manage EC2 instances (create, stop, terminate). I am unfamiliar with the service, and after looking through documentation and searching the web have not found any general advice on creating a management service. My questions are:
What programming environment/language would best be suited to creating a management program?
How can this program interact with EC2 instances? (I've looked into AWS EC2 command line tools. Can these be used from a program to create/terminate instances?)
Any general advice in accomplishing this is appreciated (links to examples especially).
What programming environment/language would best be suited to creating a management program?
This question cannot be answered in a definite way, rather you should either choose the language you are most comfortable with or that's best suited to your environment/team instead - there are plenty to choose from, most popular major languages are covered by a dedicated SDK (currently Java, .NET, Node.js, Python, PHP, Ruby), see Tools for Amazon Web Services for the detailed listing and links to further information about each.
Please note that there are also two IDE Toolkits listed that might make it easier to get started if you happen to develop in Java or C#, specifically the AWS Toolkit for Eclipse and the AWS Toolkit for Microsoft Visual Studio.
How can this program interact with EC2 instances?
All the SDKs (and also the command line tools build on top of these) do use the AWS APIs to interact with the respective services (each one has a separate API, but most of them are structured very similar), see Documentation for a listing of all currently available services and links to their documentation:
Welcome to the Amazon Web Services (AWS) Documentation. Whether you are new to AWS or an advanced user, you can find useful information about the services ranging from introductions to advanced features.
To learn how you can get started with AWS, see our Getting Started with AWS guide. If you are interested in learning more about our AWS Free Usage Tier, see our AWS free usage tier article.
I guess you are new to the cloud and aws world, you can use AWS Command line tools to management the services. Also to make things pretty simpler you can make use of the readily available aws management console if you are only worry is to start, stop or terminate the instance. Also people have build some thing called Config management system like opscode chef which is built of ruby or you can use puppet built of puppet lab's custom DSL.
I am not sure if you really need a program to do that. The Amazon Management Console ( https://console.aws.amazon.com ) is pretty straight forward, simple to use, you can spin thousands of instances in a very short time. I created 20 instances in about 3 minutes and deleted(terminated) 9 during my first interaction with the technology. Would you provide a use case where this is necessary? Its like you want to create a missile to kill a chicken(rather than buy a knife)
HTH, Thanks,
Bles
I used to work on a project that deals a lot with EC2 and one of my responsibility was to manage instances remotly( deploy/start/stor/reboot). I used Java and the Amazon API to write a communication module for the application.
In addition I made a few general ant scripts to deal with code that has to be deploed into an instance. Kind a old fashion way, but works perfectly :)

Categories

Resources