With this release we now support virtualized data connections to Athena data sources.
Fixed a bug in the implementation of parameterized queries where they didn't work in query embeds.
Fixed an issue where clicking on the organization tile from the Data page (https://data.world/data) took the user to a search results page where the search was a partial match for the organization Instead of the exact match.
When creating a virtual connection to Athena you are presented with a list of tables to expose. With this change you also see the Views that have been created there.
Fixed R integration parsing errors on columns with assumed data types.
Problem: When columns contained a large number of null values, R assumed the data types for those columns incorrectly.
Solution: Set so that when our R packages creates dataframes from query results, those dataframes use the same data types that are set in data.world (they can be found using dwapi::get_table_schema(...)) . Additionnally we have made it so the user can specify or override the default or assumed data types by passing additional function parameters to data.world::qry_sql or dwapi::sql to help them avoid this issue.
This is the second round of work on the bulk edit feature for metadata. It expands the types of metadata that can be edited on a dataset or project to include metadata that is dynamic by customer and stored in the transactional catalog.
Features include:
Ability to see any associated custom metadata defined in the customer's metadata profile when bulk editing datasets and projects
Can edit custom fields using their associated bulk edit interface
Changes are applied to the catalog for the underlying asset when the bulk edit operation is confirmed.
Adds the ability for dataset owners to mark files as deprecated and applies UI treatment to de-emphasize files.
Fixed an issue the Redshift connector couldn't find S3 backed Athena tables that were added to Redshift).
This update adds a query timer to the query tab in the workspace that records how long each query run takes to complete. The timer is displayed as the query is running, and the final runtime is displayed upon query completion:
Fixed an issue where using the data.world package 1.2.4 with dwapi-r 0.3.0 caused an 'argument "owner_id" is missing' error.
We have added an owner dropdown in the create metadata resource window which enables users to create metadata resources for any metadata catalog they have write access to:
This PR primarily updates the UI to address issues:
Full width the inputs for Athena inputs
Sentence case titles
Make external id more ui friendly with copy button
Adds some extra pattern validations for Athena inputs (s3 bucket, roleArn, aws region)
This PR also refactors the code to:reduce ts-ignores / and fix type issuesextracts validations out to it's own file.
Added the ability to specify that certain metadata fields should be multiline and block rendered.previously we rendered all metadata attributes through an inline markdown renderer, which stripped newlines and block level elements. With this change we have the ability to specify that certain fields shouldn't use the inline markdown editor, but the default markdown editor (which doesn't strip newlines, for example).