A JupyterLab extension that provides SparkSQL magic commands, a SparkSQL syntax highlighter, and visualization widgets.
npm install jupyterlab-sparksql
A JupyterLab extension that provides SparkSQL magic commands, a SparkSQL syntax highlighter, and visualization widgets.
- JupyterLab >= 3.0
To install the extension, execute:
``bash`
pip install jupyterlab-sparksql
To remove the extension, execute:
`bash`
pip uninstall jupyterlab-sparksql
Note: You will need NodeJS to build the extension package.
The jlpm command is JupyterLab's pinned version ofyarn
yarn that is installed with JupyterLab. You may use or npm in lieu of jlpm below.
`bash`Clone the repo to your local environment
Change directory to the jupyterlab-sparksql directory
Install package in development mode
pip install -e "."Link your development version of the extension with JupyterLab
jupyter labextension develop . --overwriteRebuild extension Typescript source after making changes
jlpm build
You can watch the source directory and run JupyterLab at the same time in different terminals to watch for changes in the extension's source and automatically rebuild the extension.
`bash`Watch the source directory in one terminal, automatically rebuilding when needed
jlpm watchRun JupyterLab in another terminal
jupyter lab
With the watch command running, every saved change will immediately be built locally and available in your running JupyterLab. Refresh JupyterLab to load the change in your browser (you may need to wait several seconds for the extension to be rebuilt).
By default, the jlpm build command generates the source maps for this extension to make it easier to debug using the browser dev tools. To also generate source maps for the JupyterLab core extensions, you can run the following command:
`bash`
jupyter lab build --minimize=False
`bash`
pip uninstall jupyterlab-sparksql
In development mode, you will also need to remove the symlink created by jupyter labextension developjupyter labextension list
command. To find its location, you can run to figure out where the labextensionsjupyterlab-sparksql` within that folder.
folder is located. Then you can remove the symlink named
See RELEASE