2024-11-17 18:40:59.363383: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: SSE3 SSE4.1 SSE4.2 AVX AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2024-11-17 18:40:59.388308: I external/local_xla/xla/stream_executor/rocm/rocm_executor.cc:920] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2024-11-17 18:40:59.426336: I external/local_xla/xla/stream_executor/rocm/rocm_executor.cc:920] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2024-11-17 18:40:59.426398: I external/local_xla/xla/stream_executor/rocm/rocm_executor.cc:920] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2024-11-17 18:40:59.426474: I external/local_xla/xla/stream_executor/rocm/rocm_executor.cc:920] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2024-11-17 18:40:59.426527: I external/local_xla/xla/stream_executor/rocm/rocm_executor.cc:920] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2024-11-17 18:40:59.426584: I external/local_xla/xla/stream_executor/rocm/rocm_executor.cc:920] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2024-11-17 18:40:59.426611: I tensorflow/core/common_runtime/gpu/gpu_device.cc:2021] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 11220 MB memory: -> device: 0, name: AMD Radeon RX 6700 XT, pci bus id: 0000:0a:00.0
2024-11-17 18:41:00.232319: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:388] MLIR V1 optimization pass is not enabled
2024-11-17 18:41:02.060300: F ./tensorflow/core/kernels/conv_2d_gpu.h:708] Non-OK-status: GpuLaunchKernel( SwapDimension1And2InTensor3UsingTiles<T, NumThreads, TileLongSide, TileShortSide, conjugate>, total_tiles_count, NumThreads, 0, d.stream(), input, input_dims, output)
Status: INTERNAL: Cuda call failed with 98
Received signal 6
#0 0x756dbc624299 base::debug::CollectStackTrace()
#1 0x756dbc610daa base::debug::StackTrace::StackTrace()
#2 0x756dbc6233ca base::debug::(anonymous namespace)::StackDumpSignalHandler()
#3 0x756db4c45320 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x4531f)
#4 0x756db4c9eb1c pthread_kill
#5 0x756db4c4526e gsignal
#6 0x756db4c288ff abort
#7 0x756b73808b00 <unknown>
#8 0x756b73808b20 <unknown>
#9 0x756b6b7188bf <unknown>
#10 0x756b6b7488e6 <unknown>
#11 0x756b6b747f23 <unknown>
#12 0x756b6b6e1c56 <unknown>
#13 0x756b6b6d8d74 <unknown>
#14 0x756b6b6d86d0 <unknown>
#15 0x756b6b6d76b4 <unknown>
#16 0x756b667a349d <unknown>
#17 0x756b667a2c18 <unknown>
#18 0x756cbdb3d839 <unknown>
#19 0x756cbdc3d00d <unknown>
#20 0x756b737dda65 <unknown>
#21 0x756b737dd361 <unknown>
#22 0x756b7369e0da <unknown>
#23 0x756db4c9ca94 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x9ca93)
#24 0x756db4d29c3c (/usr/lib/x86_64-linux-gnu/libc.so.6+0x129c3b)
r8: 00007569340008e0 r9: 0000000000000007 r10: 0000000000000008 r11: 0000000000000246
r12: 0000000000000006 r13: 0000000000000400 r14: 0000000000000016 r15: 0000756c31ffeb98
di: 0000000000001351 si: 000000000000159d bp: 0000756c31ffe830 bx: 000000000000159d
dx: 0000000000000006 ax: 0000000000000000 cx: 0000756db4c9eb1c sp: 0000756c31ffe7f0
ip: 0000756db4c9eb1c efl: 0000000000000246 cgf: 002b000000000033 erf: 0000000000000000
trp: 0000000000000000 msk: 0000000000000000 cr2: 0000000000000000
[end of stack trace]