4,990 questions
1
vote
1
answer
38
views
udf returning Ljava.lang.Object;@ [closed]
I have a PySpark UDF which when I try to apply to each row for one of the df columns and get a new column, I get a [Ljava.lang.Object;@7e44638d (different value after the @ for each row)
Please see ...
- 75
0
votes
1
answer
51
views
Snowflake UDF error - Unsupported subquery type cannot be evaluated
I've tried several strategies to force Snowflake to recognize that I'm only returning one row per input row, including:
Aggregation with Min(), Max(), and Any_Value()
Using LIMIT 1
Putting my logic ...
- 1
-3
votes
0
answers
45
views
postgresql- passing results of function into another function
I have a function called udf_unixtimestaptodatetime. based off of the unixtimestamp it will provide the associated date and time. the script works when placing in the unixdatetime (along with other ...
1
vote
1
answer
70
views
Adding more data causes Pandas UDF to return error
I am new to Pyspark and I have created a pandas udf. The purpose of this udf is to accept a series and apply an ML model on it. I have data that has these columns:
ID, models_name, prices, units_sold, ...
- 139
0
votes
0
answers
73
views
Excel UDF: use Characters object without ScreenUpdating
It appears that if an Excel VBA user-defined function makes use of a Characters object, the cell in which that function is used displays some part of that object while the VBA code is running, even if ...
- 559
0
votes
1
answer
94
views
Passing values from a CTE (Common Table Expression) to user-defined functions (UDF) in Spark SQL / Databricks
I'm trying to pass a value from a CTE to my function (UDF). Unfortunately, it's not working.
Here is the first variant:
WITH fx_date_new AS (
SELECT CASE
WHEN '2025-01-01' > ...
- 1
0
votes
1
answer
32
views
Identifying and Updating UDF Dependencies for Hive Metastore to Unity Catalog Migration
I am currently working on a Hive Metastore to Unity Catalog migration in Databricks. As part of this process, I need to upgrade several components, including workflows and clusters.
I would like ...
0
votes
0
answers
65
views
Snowflake: "Unsupported subquery type cannot be evaluated" when using a function with a subquery on a JSON column
In Snowflake I'm trying to de-identify data stored in a JSON column based on configurations in a separate table. I created a custom SQL function DEIDENTIFY_JSON which uses a subquery to look up the de-...
- 389
1
vote
2
answers
122
views
How to write Excel UDF so that it can handle being passed a single cell, or array of cells
Background
I wrote the below UDF to check whether a cell's contents is valid (i.e. if a cell's data validation is set to a list of A,B,C. Returns TRUE if the cell is "A", "B" or &...
- 416
0
votes
0
answers
34
views
Using pyspark databricks UDFs with outside function imports
Problem with minimal example
The below minimal example does not run locally with databricks-connect==15.3 but does run within databricks workspace.
main.py
from databricks.connect import ...
- 1
0
votes
1
answer
111
views
Error with Excel Lambda function in Name manager
I have set up a Lambda formula that calculates interpolated values from a given set of coordinates
similar to existing trend/linest/forecast functions
handles non consecutive inputs as well as errors ...
1
vote
1
answer
28
views
import script value in different script with new results (diceroller)
I'm learning to write python to create scripts to automate stuff for DD.
And I'm positive that there most likely is a built in solution for this.
I have certain functions from external scripts that I ...
- 11
0
votes
1
answer
45
views
np.clip functionality using pyarrow compute in duckdb udf
Iam currently working on a duckdb udf using pyarrow compute. Works great so far.
Now i need to clip a value between 0 and 1, e.g minimal example:
import numpy as np
import pyarrow as pa
import pyarrow....
0
votes
1
answer
22
views
postgresql cannot use concatenated variables in user defined function
Creating function to extract data from views, whose name prefix is passed as function parameter:
CREATE FUNCTION t (char(2)) RETURNS text AS $$
DECLARE view_name TEXT;
BEGIN
view_name := CONCAT($1, '...
- 31
3
votes
2
answers
42
views
postgresql concat error when used in function
PostgreSQL syntax error when using CONCAT in user defined function.
Using DbVisualizer as SQL client.
CREATE FUNCTION t() RETURNS TEXT
AS ' SELECT CONCAT('some', '_text') ; '
LANGUAGE plpgsql;
[Code:...
- 31