Orange: Python Script: Difference between revisions

From OnnoCenterWiki
Jump to navigationJump to search
Onnowpurbo (talk | contribs)
Created page with "Sumber: https://docs.biolab.si//3/visual-programming/widgets/data/pythonscript.html Extends functionalities through Python scripting. Inputs Data (Orange.data.Table): i..."
 
Onnowpurbo (talk | contribs)
No edit summary
Line 6: Line 6:


     Data (Orange.data.Table): input dataset bound to in_data variable
     Data (Orange.data.Table): input dataset bound to in_data variable
     Learner (Orange.classification.Learner): input learner bound to in_learner variable
     Learner (Orange.classification.Learner): input learner bound to in_learner variable
     Classifier (Orange.classification.Learner): input classifier bound to in_classifier variable
     Classifier (Orange.classification.Learner): input classifier bound to in_classifier variable
     Object: input Python object bound to in_object variable
     Object: input Python object bound to in_object variable


Line 16: Line 13:


     Data (Orange.data.Table): dataset retrieved from out_data variable
     Data (Orange.data.Table): dataset retrieved from out_data variable
     Learner (Orange.classification.Learner): learner retrieved from out_learner variable
     Learner (Orange.classification.Learner): learner retrieved from out_learner variable
     Classifier (Orange.classification.Learner): classifier retrieved from out_classifier variable
     Classifier (Orange.classification.Learner): classifier retrieved from out_classifier variable
     Object: Python object retrieved from out_object variable
     Object: Python object retrieved from out_object variable


Line 29: Line 23:
For instance the following script would simply pass on all signals it receives:
For instance the following script would simply pass on all signals it receives:


out_data = in_data
out_data = in_data
out_distance = in_distance
out_distance = in_distance
out_learner = in_learner
out_learner = in_learner
out_classifier = in_classifier
out_classifier = in_classifier
out_object = in_object
out_object = in_object


Note: You should not modify the input objects in place.
Note: You should not modify the input objects in place.


../../_images/PythonScript-stamped.png
[[File:PythonScript-stamped.png|center|200px|thumb]]
 


     Info box contains names of basic operators for Orange Python script.
     Info box contains names of basic operators for Orange Python script.
Line 49: Line 44:
     Console displays the output of the script.
     Console displays the output of the script.


Examples
==Contoh==


Python Script widget is intended to extend functionalities for advanced users. Classes from Orange library are described in the documentation. To find further information about orange Table class see Table, Domain, and Variable documentation.
Python Script widget is intended to extend functionalities for advanced users. Classes from Orange library are described in the documentation. To find further information about orange Table class see Table, Domain, and Variable documentation.
Line 55: Line 50:
One can, for example, do batch filtering by attributes. We used zoo.tab for the example and we filtered out all the attributes that have more than 5 discrete values. This in our case removed only ‘leg’ attribute, but imagine an example where one would have many such attributes.
One can, for example, do batch filtering by attributes. We used zoo.tab for the example and we filtered out all the attributes that have more than 5 discrete values. This in our case removed only ‘leg’ attribute, but imagine an example where one would have many such attributes.


from Orange.data import Domain, Table
from Orange.data import Domain, Table
domain = Domain([attr for attr in in_data.domain.attributes
domain = Domain([attr for attr in in_data.domain.attributes
                if attr.is_continuous or len(attr.values) <= 5],
                  if attr.is_continuous or len(attr.values) <= 5],
                in_data.domain.class_vars)
                in_data.domain.class_vars)
out_data = Table(domain, in_data)
out_data = Table(domain, in_data)
 
[[File:PythonScript-filtering.png|center|200px|thumb]]


../../_images/PythonScript-filtering.png


The second example shows how to round all the values in a few lines of code. This time we used wine.tab and rounded all the values to whole numbers.
The second example shows how to round all the values in a few lines of code. This time we used wine.tab and rounded all the values to whole numbers.


import numpy as np
import numpy as np
out_data = in_data.copy()
out_data = in_data.copy()
#copy, otherwise input data will be overwritten
#copy, otherwise input data will be overwritten
np.round(out_data.X, 0, out_data.X)
np.round(out_data.X, 0, out_data.X)
 
[[File:PythonScript-round.png|center|200px|thumb]]


../../_images/PythonScript-round.png


The third example introduces some Gaussian noise to the data. Again we make a copy of the input data, then walk through all the values with a double for loop and add random noise.
The third example introduces some Gaussian noise to the data. Again we make a copy of the input data, then walk through all the values with a double for loop and add random noise.


import random
import random
from Orange.data import Domain, Table
from Orange.data import Domain, Table
new_data = in_data.copy()
new_data = in_data.copy()
for inst in new_data:
for inst in new_data:
  for f in inst.domain.attributes:
  for f in inst.domain.attributes:
    inst[f] += random.gauss(0, 0.02)
    inst[f] += random.gauss(0, 0.02)
out_data = new_data
out_data = new_data
 
[[File:PythonScript-gauss.png|center|200px|thumb]]


../../_images/PythonScript-gauss.png


The final example uses Orange3-Text add-on. Python Script is very useful for custom preprocessing in text mining, extracting new features from strings, or utilizing advanced nltk or gensim functions. Below, we simply tokenized our input data from deerwester.tab by splitting them by whitespace.
The final example uses Orange3-Text add-on. Python Script is very useful for custom preprocessing in text mining, extracting new features from strings, or utilizing advanced nltk or gensim functions. Below, we simply tokenized our input data from deerwester.tab by splitting them by whitespace.


print('Running Preprocessing ...')
print('Running Preprocessing ...')
tokens = [doc.split(' ') for doc in in_data.documents]
tokens = [doc.split(' ') for doc in in_data.documents]
print('Tokens:', tokens)
print('Tokens:', tokens)
out_object = in_data
out_object = in_data
out_object.store_tokens(tokens)
out_object.store_tokens(tokens)


You can add a lot of other preprocessing steps to further adjust the output. The output of Python Script can be used with any widget that accepts the type of output your script produces. In this case, connection is green, which signalizes the right type of input for Word Cloud widget.
You can add a lot of other preprocessing steps to further adjust the output. The output of Python Script can be used with any widget that accepts the type of output your script produces. In this case, connection is green, which signalizes the right type of input for Word Cloud widget.


../../_images/PythonScript-Example3.png
[[File:PythonScript-Example3.png|center|200px|thumb]]
 
 
 





Revision as of 06:09, 21 January 2020

Sumber: https://docs.biolab.si//3/visual-programming/widgets/data/pythonscript.html

Extends functionalities through Python scripting.

Inputs

   Data (Orange.data.Table): input dataset bound to in_data variable
   Learner (Orange.classification.Learner): input learner bound to in_learner variable
   Classifier (Orange.classification.Learner): input classifier bound to in_classifier variable
   Object: input Python object bound to in_object variable

Outputs

   Data (Orange.data.Table): dataset retrieved from out_data variable
   Learner (Orange.classification.Learner): learner retrieved from out_learner variable
   Classifier (Orange.classification.Learner): classifier retrieved from out_classifier variable
   Object: Python object retrieved from out_object variable

Python Script widget can be used to run a python script in the input, when a suitable functionality is not implemented in an existing widget. The script has in_data, in_distance, in_learner, in_classifier and in_object variables (from input signals) in its local namespace. If a signal is not connected or it did not yet receive any data, those variables contain None.

After the script is executed variables from the script’s local namespace are extracted and used as outputs of the widget. The widget can be further connected to other widgets for visualizing the output.

For instance the following script would simply pass on all signals it receives:

out_data = in_data
out_distance = in_distance
out_learner = in_learner
out_classifier = in_classifier
out_object = in_object

Note: You should not modify the input objects in place.


   Info box contains names of basic operators for Orange Python script.
   The Library control can be used to manage multiple scripts. Pressing “+” will add a new entry and open it in the Python script editor. When the script is modified, its entry in the Library will change to indicate it has unsaved changes. Pressing Update will save the script (keyboard shortcut “Ctrl+S”). A script can be removed by selecting it and pressing the “-“ button.
   Pressing Execute in the Run box executes the script (keyboard shortcut “Ctrl+R”). Any script output (from print) is captured and displayed in the Console below the script.
   The Python script editor on the left can be used to edit a script (it supports some rudimentary syntax highlighting).
   Console displays the output of the script.

Contoh

Python Script widget is intended to extend functionalities for advanced users. Classes from Orange library are described in the documentation. To find further information about orange Table class see Table, Domain, and Variable documentation.

One can, for example, do batch filtering by attributes. We used zoo.tab for the example and we filtered out all the attributes that have more than 5 discrete values. This in our case removed only ‘leg’ attribute, but imagine an example where one would have many such attributes.

from Orange.data import Domain, Table
domain = Domain([attr for attr in in_data.domain.attributes
                 if attr.is_continuous or len(attr.values) <= 5],
                in_data.domain.class_vars)
out_data = Table(domain, in_data)


The second example shows how to round all the values in a few lines of code. This time we used wine.tab and rounded all the values to whole numbers.

import numpy as np
out_data = in_data.copy()
#copy, otherwise input data will be overwritten
np.round(out_data.X, 0, out_data.X)


The third example introduces some Gaussian noise to the data. Again we make a copy of the input data, then walk through all the values with a double for loop and add random noise.

import random
from Orange.data import Domain, Table
new_data = in_data.copy()
for inst in new_data:
  for f in inst.domain.attributes:
    inst[f] += random.gauss(0, 0.02)
out_data = new_data


The final example uses Orange3-Text add-on. Python Script is very useful for custom preprocessing in text mining, extracting new features from strings, or utilizing advanced nltk or gensim functions. Below, we simply tokenized our input data from deerwester.tab by splitting them by whitespace.

print('Running Preprocessing ...')
tokens = [doc.split(' ') for doc in in_data.documents]
print('Tokens:', tokens)
out_object = in_data
out_object.store_tokens(tokens)

You can add a lot of other preprocessing steps to further adjust the output. The output of Python Script can be used with any widget that accepts the type of output your script produces. In this case, connection is green, which signalizes the right type of input for Word Cloud widget.


Referensi

Pranala Menarik